System and method for creating, storing and delivering self-guided audio tours

ABSTRACT

A system for delivering a self-guided audio tour to an end user, the system comprising: a central server comprising: a database; a tour instruction file stored in the database, the tour instruction file comprising: a tour type; a tour path comprising a plurality of tour points; an order of the tour points on the tour path; location information identifying the real-world position of each of the tour points on the tour path; and data to be delivered to the end user for each of the tour points on the tour path; and a personal electronic device comprising: a central processing unit; a wireless transceiver in communication with the central processing unit for wirelessly communicating with the central server; a position determination unit in communication with the central processing unit for identifying the real-world position of the personal electronic device; a display in communication with the central processing unit; at least one acoustic output unit in communication with the central processing unit; and a software app running on the central processing unit for: using the position determination unit to identify the real-world position of the personal electronic device; comparing the real-world position of the personal electronic device with the tour path to determine if the personal electronic device is located at one of the plurality of tour points; if the end user is at one of the plurality of tour points, and if the end user reached that tour point following the order of the tour points on the tour path, delivering the data from the tour instruction file for that tour point.

Reference To Pending Prior Patent Applications

This patent application is a continuation of pending prior U.S. patentapplication Ser. No. 16/832,909, filed Mar. 27, 2020 by Gregory J. Dunnet al. for SYSTEM AND METHOD FOR CREATING, STORING AND DELIVERINGSELF-GUIDED AUDIO TOURS, which patent application:

(i) claims benefit of prior U.S. Provisional Patent Application Ser. No.62/824,495, filed Mar. 27, 2019 by Gregory J. Dunn, Jr. for ADVANCEDDATA TRIGGER MOBILE TOUR DELIVERY SYSTEM-GPS;

(ii) claims benefit of prior U.S. Provisional Patent Application Ser.No. 62/829,215, filed Apr. 4, 2019 by Gregory J. Dunn, Jr. et al. forADT MOBILE TOUR PUBLISHING PLATFORM;

(iii) claims benefit of prior U.S. Provisional Patent Application Ser.No. 62/829,204, filed Apr. 4, 2019 by Gregory J. Dunn, Jr. for ADVANCEDDATA TRIGGER MOBILE TOUR DELIVERY SYSTEM-BLUETOOTH APPLICATIONS;

(iv) claims benefit of prior U.S. Provisional Patent Application Ser.No. 62/844,207, filed May 7, 2019 by Gregory J. Dunn, Jr. forINTERACTIVE AUGMENTED REALITY DATA DELIVERY STYLE CHOICE OPTIONS FORADVANCED DATA TRIGGER MOBILE TOUR DELIVERY SYSTEM —GPS/BLUETOOTH; and

(v) claims benefit of prior U.S. Provisional Patent Application Ser. No.62/902,549, filed Sep. 19, 2019 by Gregory J. Dunn, Jr. for TOUR BYNUMBERS MOBILE TOUR SOLUTION WITH SOUND INNOVATION AND AUDIOTEXT-TO-AUDIO TRANSLATION INNOVATION FOR MOBILE TOURS.

The six (6) above-identified patent applications are hereby incorporatedherein by reference.

FIELD OF THE INVENTION

This invention relates to self-guided audio tours in general, and moreparticularly to a novel system for creating, storing and delivering aself-guided audio tour to an end user.

BACKGROUND OF THE INVENTION

Self-guided audio tours using portable electronic devices to deliver thetour to an end user are known, however, conventional self-guided audiotours suffer from several significant disadvantages.

By way of example but not limitation, conventional self-guided audiotours typically rely upon the use of a proprietary handset which the enduser carries during the tour, and into which the end user enters numbersthat are keyed to a particular location/exhibit so that the handsetplays the audio associated with that particular exhibit.

The use of proprietary handsets requires (i) the programming andmaintenance of the handsets, (ii) end user interaction to operate thehandset (i.e., the end user must locate the appropriate number for aparticular exhibit and manually input the appropriate number into thehandset), and (iii) maintenance and management of the handsets (e.g.,charging, programming, lending out to end users, cleaning, etc.).Furthermore, such systems do not ordinarily provide any way to directthe end user from one location/exhibit to another location/exhibit.

It is known in the prior art to use global positioning system (GPS)coordinates and GPS-linked maps to guide end users on self-guided audiotours, however, such prior art GPS-based systems also suffer fromsignificant drawbacks.

By way of example but not limitation, GPS signals can be inaccurate (ornon-existent) when the receiver is located indoors, when metal objectsare near the receiver, when the receiver is disposed within a case(e.g., within a smartphone case), when buildings reflect GPS signals,when atmospheric changes or weather affect the GPS signal, and/orlocations/exhibits on a particular tour path can be disposed so closetogether that GPS signals are not accurate for discriminating betweenparticular locations/exhibits, and hence such a prior art system maymisidentify the location/exhibit that the end user is actually viewingwhen the system relies on GPS coordinates to make the determination ofposition (i.e., the end user is at the second stop of a tour, but theGPS receiver erroneously concludes that the end user is two blocks awayat the fourth stop, and the GPS-based tour plays the fourth stop ratherthan the second stop, since the GPS erroneously concluded that the enduser was at the fourth stop.

In addition, when an end user is undertaking a self-guided audio tourthat relies on GPS coordinates to identify locations/exhibits on thetour, and when the end user is in the space between two exhibits (e.g.,in a gallery of a museum with painting exhibits on different walls), theGPS coordinates may correctly identify the gallery, but will not be ableto identify which exhibit the user is viewing. As a result, since such aprior art system does not know the orientation of the user, the systemcannot guide the user from one exhibit to another exhibit.

In addition to GPS, some prior art systems utilize localized beacons(e.g., BlueTooth beacons) that identify when a user is in proximity to aBluetooth beacon and play the appropriate audio file for that particularBluetooth beacon.

However, where prior art systems utilize BlueTooth beacons to identify aparticular exhibit, such systems suffer from being unable todiscriminate between BlueTooth beacons having overlapping zones, andhence such systems can misidentify an exhibit and play the incorrectaudio relative to the exhibit that the user is actually viewing.

In addition, prior art systems deliver only “static” audio to the enduser, that is, audio that is unrelated to the actions and movement ofthe end user. In this respect, the “static” audio of prior art systemsis not varied to reflect the direction that the end user is facingvis-à-vis the location/exhibit being described, and the “static” audiodelivered to the end user is unrelated to the end user's distance fromthe exhibit being described, etc., since the prior art systems do notknow orientation of user vis-à-vis the location/exhibit being described.

Such prior art systems also generally require the end user to listen toan entire audio file before moving on to next exhibit, or such systemscontinue playing the same audio file despite the fact that the end userhas moved to a different exhibit, thereby confusing the end user.

In addition, when developing the tours, the tour creator lacks thechoice of audio styles that are delivered at each location. The tourcreator is only presented with one choice, a pre-defined audio file thatplays until it is presented with a new location trigger. This singlepre-defined audio style (i.e., “one size fits all” for every location)creates limitations. The present invention allows for tour creators tochoose various audio styles to suit the environment and story.

In addition, with current systems, the tour creator has no option toexpand on current location stories. The end user must listen to theentire story no matter how long. There is no “addition option” to expandon the story. With the present invention, the tour creator can easilybuild in a choice for the end user to expand on the story, if they sochoose.

And, with prior art systems, the audio that is delivered to the end useris played either through headphones or through a main speaker only. Therequirement that the end user wear headphones isolates the end user fromothers (and/or causes a potentially hazardous distraction, such as whenengaging in a tour outdoors, crossing streets, etc.), and the use of amain speaker can be disruptive in indoor environments (e.g., a museum),and particularly when multiple users are undertaking tourssimultaneously.

Finally, it should be appreciated that where proprietary handsets orproprietary software (e.g., existing third-party apps) are used todeliver a self-guided audio tour, such systems are not easy todistribute across different platforms (e.g., different operating systemssuch as iOS, Android, etc.), and encumbers the end user by forcing theend user to either utilize proprietary hardware (e.g., handsets), ordownload proprietary apps (e.g., third-party apps) to run on the user'sown portable electronic device (e.g., a smartphone). Hence, apps need tobe developed and maintained for multiple platforms (e.g., iOS, Android,etc.).

Furthermore, apps are typically location-specific and developed by thirdparties for those particular locations. By way of example but notlimitation, a user may need to download a “Museum of Art” app whenvisiting the Museum of Art to run a self-guided audio tour on the user'ssmartphone, and then the user may need to download an entirely differentapp when visiting a different museum (e.g., a “Museum of Science” appwhen visiting the Museum of Science, a “Museum of History” app whenvisiting the Museum of History, a “Freedom Trail” app when walking theFreedom Trail, etc.). Requiring different apps for different locations(and requiring the user to download and install such apps) is asignificant drawback of prior art systems, and makes it difficult fortour creators to distribute tours to users.

Also, with current apps that provide GPS tours or provide museum tours,these apps only provide one type of tour. There is no software solutionthat allows a tour creator to create multiple types of tours (i.e. GPStours, Bluetooth tours, tour-by-number tours, virtual tours, etc.) andpublish them to a marketplace app that provides many tour experiences toend users on multiple platforms (e.g., iOS, Android, etc.)

Thus there is need for a new and improved way to create novel audiotours and a new and improved way to store and deliver novel audio toursto the personal electronic device (e.g., a smartphone) of a user whichavoids the difficulties of the prior art.

SUMMARY OF THE INVENTION

The present invention comprises a new and improved way to create novelaudio tours, and a new and improved way to store and deliver novel audiotours to the personal electronic device (e.g., a smartphone) of a userwhich avoids the difficulties of the prior art.

In one form of the invention, there is provided a system for deliveringa self-guided audio tour to an end user, said system comprising:

a central server comprising:

-   -   a database;    -   a tour instruction file stored in said database, said tour        instruction file comprising:        -   a tour type;        -   a tour path comprising a plurality of tour points;        -   an order of said tour points on said tour path;        -   location information identifying the real-world position of            each of said tour points on said tour path; and        -   data to be delivered to the end user for each of said tour            points on said tour path; and

a personal electronic device comprising:

-   -   a central processing unit;    -   a wireless transceiver in communication with said central        processing unit for wirelessly communicating with said central        server;    -   a position determination unit in communication with said central        processing unit for identifying the real-world position of said        personal electronic device;    -   a display in communication with said central processing unit;    -   at least one acoustic output unit in communication with said        central processing unit; and    -   a software app running on said central processing unit for:        -   using said position determination unit to identify the            real-world position of said personal electronic device;        -   comparing said real-world position of said personal            electronic device with said tour path to determine if said            personal electronic device is located at one of said            plurality of tour points;        -   if the end user is at one of said plurality of tour points,            and if the end user reached that tour point following said            order of said tour points on said tour path, delivering the            data from said tour instruction file for that tour point.

In another form of the invention, there is provided a method fordelivering a tour to an end user, wherein the tour comprises a tour pathcomprising a plurality of tour points, an order of the tour points onthe tour path, location information identifying the real-world positionof each of the tour points on the tour path, and data to be delivered tothe end user for each of the tour points on the tour path, said methodcomprising:

identifying the real-world position of the end user;

comparing said real-world position of the end user with the tour path todetermine if the end user is located at one of the plurality of tourpoints; and

if the end user is at one of the plurality of tour points, and if theend user reached that tour point following the order of the tour pointson the tour path, delivering the data for that tour point to the enduser.

In another form of the invention, there is provided a method forcreating a tour instruction file to be used on a personal electronicdevice to provide a self-guided audio tour to an end user, said methodcomprising:

defining a tour path comprising a plurality of tour points having asequence;

for each of said plurality of tour points on said tour path, defining:

-   -   a sequence number for that tour point;    -   a real-world location for that tour point;    -   a data file to be delivered to the end user when the end user is        positioned at that tour point; and

storing the tour instruction file in a central database.

In another form of the invention, there is provided a computer programproduct embodied in a non-transitory computer-readable medium forcreating a tour instruction file to be used on a personal electronicdevice to provide a self-guided audio tour to an end user, the computerprogram product comprising code which causes one or more processors toperform the operations of:

querying a tour creator to define a tour path comprising a plurality oftour points having a sequence, wherein, for each of said plurality oftour points on said tour path, further querying the tour creator todefine for that tour point:

-   -   a sequence number for that tour point;    -   a real-world location for that tour point;    -   a data file to be delivered to the end user when the end user is        positioned at that tour point; and

storing the tour path in a database.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other objects and features of the present invention will bemore fully disclosed or rendered obvious by the following detaileddescription of the preferred embodiments of the invention, which is tobe considered together with the accompanying drawings wherein likenumbers refer to like parts, and further wherein:

FIG. 1 is a schematic view showing a novel mobile tour delivery systemformed in accordance with the present invention;

FIGS. 2 and 3 are a schematic views showing the relationship between anEnd User, a plurality of locations/exhibits, and GPS coordinates for theplurality of locations/exhibits (note that in FIG. 2, the GPS coordinatesystem correctly detects the location of the End User, whereas in FIG.3, the GPS coordinate system incorrectly detects the location of the EndUser);

FIGS. 4-6 are schematic views showing further aspects of a novel mobiletour delivery system formed in accordance with the present invention;

FIG. 7 is a schematic view showing a standard tour path formed inaccordance with the present invention;

FIG. 8 is a schematic view showing a loop tour path formed in accordancewith the present invention;

FIG. 9 is a schematic view showing a standard tour path comprising DigDeeper extension paths formed in accordance with the present invention;

FIG. 10 is a schematic view showing a standard tour path comprisingvarious stops/locations/exhibits formed in accordance with the presentinvention;

FIG. 11 is a schematic view showing a standard tour path formed inaccordance with the present invention;

FIGS. 12 and 13 are a schematic views showing a standard tour pathformed in accordance with the present invention, wherein the standardtour path comprises a plurality of stops/locations/exhibits disposedalong the tour path, and associated GPS coordinates and order numbersfor the plurality of stops/locations/exhibits disposed on the tour path;

FIGS. 14-17 are schematic views showing aspects of a tour path assignedaccording to Bluetooth beacons;

FIGS. 18 and 19 are schematic views showing various aspects furtheraspects of a novel mobile tour delivery system formed in accordance withthe present invention;

FIG. 20 is a schematic view showing various aspects of a dynamic audiofeature formed in accordance with the present invention;

FIG. 21 is a schematic view showing further aspects of a Dig Deeperextension formed in accordance with the present invention;

FIGS. 22-24 are schematic views showing aspects of a novel applicationformed in accordance with the present invention; and

FIGS. 26-28 are schematic views showing a novel tour creator feature forfacilitating the creation of self-guided audio tours using the novelmobile tour delivery system of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

1. Novel System for Creating and Distributing

Mobile Tours

The present invention provides a new and improved way to design novelaudio tours and a new and improved way to deliver novel audio tours tothe personal electronic device (e.g., a smartphone) of an end user whichavoids the difficulties of the prior art.

The present invention enables the creation of a mobile tour instructionfile defining a particular self-guided audio tour which can be stored ona central server (which is preferably connected to the Internet), suchthat any end user with a portable electronic device (e.g., a smartphone,tablet, personal computer, smartwatch, smartglasses, etc.), equippedwith a transceiver for wirelessly receiving and/or transmitting datafrom a remote source (e.g., the Internet), location finding electronics(e.g., a GPS receiver) and acoustic output means (e.g., a speaker,headphones, etc.) can wirelessly connect with a remote server and runthe mobile tour instruction file on the user's own portable electronicdevice so that the user can engage in the self-guided audio tour.

More particularly, and looking now at FIG. 1, there is shown a novelmobile tour delivery system 5. Mobile tour delivery system 5 generallycomprises a computer 10, a central server 15 containing a tour database20, and a personal electronic device 25 (e.g., a smartphone, a tablet, aportable computer, a smartwatch, smartglasses, and headphones, eitheralone or in combination with one another).

Computer 10 is typically a desktop or mobile computer which may be usedto generate a novel tour instruction file 30 that is stored on centralserver 15 in tour database 20. Tour instruction file 30 comprises adigital file defining the parameters of a particular self-guided audiotour, and includes all audio/text/video files required for the tour. Inone preferred form of the invention, computer 10 utilizes software(e.g., software running on central server 15 and provided to computer 10via a web-based interface) to generate the novel tour instruction file30 and to store the novel tour instruction file 30 in tour database 20on central server 15, as will hereinafter be discussed in furtherdetail.

Personal electronic device 25 is typically an end user's smartphone, butmay be any electronic device (e.g., a tablet, personal computer,smartwatch, smartglasses, etc.) configured to receive digitalinformation and present that information to a user, as will beappreciated by one of ordinary skill in the art in view of the presentdisclosure. Personal electronic device 25 preferably comprises a display35, an acoustic output means (e.g., a speaker) 40, and a wirelesstransceiver 45 (e.g., a cellular and/or wireless network adapter) forreceiving digital data from central server 15 and/or for transmittingdata to central server 15. Personal electronic device 25 preferably alsocomprises a GPS receiver 50, a Bluetooth transceiver 55 for wirelesslyreceiving and/or transmitting signals via Bluetooth and an inertialmeasurement unit (IMU) 60 for sensing the position and disposition ofpersonal electronic device 25 relative to Earth gravity.

In use, computer 10 is used by a tour creator (e.g., a third-party) togenerate a tour instruction file 30 which is stored in tour database 20on central server 15. Tour instruction file 30 comprises all of theparameters of a tour, including locations of particularlocations/exhibits, the order in which locations/exhibits are to bevisited by the end user, the particular audio files to be played whenthe end user is proximate an location/exhibit or en route to anlocation/exhibit, etc.

When an end user desires to undertake a particular self-guided audiotour, the end user's personal electronic device 25 connects to centralserver 15 (e.g., via the Internet) using wireless transceiver 45, andthe end user accesses the desired tour instruction file 30 (e.g., bynavigating through a web-based interface using display 35 or othermeans).

Once the appropriate tour instruction file 30 has been identified,personal electronic device 25 downloads (or digitally streams) theappropriate elements of the particular tour, identifying a particularstarting point for the self-guided audio tour (e.g., via GPS, Bluetoothbeacon, etc.), and directs the end user to the starting point (e.g., thefirst location/exhibit on the tour) for the self-guided audio tour. Theself-guided audio tour then commences, with central server 15 deliveringappropriate audio (and/or text and/or video) to personal electronicdevice 25, presenting the audio to the user via acoustic output means 40(and presenting any text and/or video to the user via display 35).

During the self-guided audio tour, display 35 can function as aninput/output device to provide selections to the end user (such asprompts to start or stop the tour, select an option during the tour,etc.), and the end user can use display 35 as an input device to makeselections (such as by touching a button on display 35, or by selectingfrom a menu on display 35, etc.). Furthermore, during the self-guidedaudio tour, and as will hereinafter be discussed in further detail,other elements of personal electronic device 25 (e.g., a microphone onthe smartphone, or headphones) can function as an input/output device toprovide selections to the end user (such as by providing options to theend user in the form of an audio prompt), and the end user can use otherelements of the personal electronic device 25 as an input device to makeselections (e.g., by using the microphone on a smartphone to providevoice input, or by tapping on the housing of an IMU-equipped smartphoneso as to indicate a selection via the tapping, or by tapping on anearpiece of IMU-equipped headphones to indicate a selection via thetapping, etc.).

When the audio (and/or text and/or video) for the first location/exhibiton the self-guided audio tour has been delivered to the end user, theend user is directed to move to the next exhibit on the tour viapersonal electronic device 25 (e.g., via an audio prompt and/ordirections), as will hereinafter be discussed in further detail.

It will be appreciated that, where tour instruction file 30 identifiesthe location of a particular location/exhibit by GPS coordinates, GPSreceiver 50 of personal electronic device 25 may be used to guide theuser to the particular location/exhibit (and from that particularlocation/exhibit to the next exhibit/location on the tour, etc.), aswill hereinafter be discussed in further detail.

Alternatively and/or additionally, where tour instruction file 30identifies the location of a particular exhibit/location by Bluetoothbeacon, personal electronic device 25 may direct a user from oneexhibit/location (i.e., a first Bluetooth beacon) to anotherexhibit/location (i.e., a second Bluetooth beacon), as will hereinafterbe discussed in further detail.

It will be appreciated that where personal electronic device 25comprises inertial measurement unit (IMU) 60, the end user may bedirected (e.g., via audio prompt from acoustic output means 40) to facea particular direction during the tour (e.g., “turn left”) and/or theaudio delivered to the end user may be augmented to reflect the user'sposition relative to a particular exhibit (e.g., augmented so that theaudio sounds as if it is delivered from the exhibit, etc.), as willhereinafter be discussed in further detail.

2. Advanced Data Trigger Mobile Tour Delivery System—GPS

2.1 Background

If an End User is in a new city and desires to undertake a self-guidedaudio tour, the End User typically has the option of anapplication-based tour that can be played on the End User's smartphoneor other mobile device (e.g., a tablet). The smartphone/other mobiledevice is typically connected to a network (e.g., via a cellular signal)and typically comprises a GPS chip for location tracking.

The End User can download an application to their smartphone that can beused to guide the End User to specific locations on the self-guided tour(e.g., historical sites).

Each location on the self-guided tour has a GPS coordinate (e.g.,Granary Burial Ground in Boston, Mass. is at Latitude: 42.3574,Longitude: −71.0618).

With such an app, when the smartphone/other mobile device of the EndUser acquires the GPS coordinate of the End User, an audio file isplayed on the End User's smartphone/other mobile device via theapplication on their smartphone/other mobile device.

The application on the smartphone/other mobile device could identifymultiple locations (each of which location has its own GPS coordinates)for the End User to follow in a group. This grouping then makes them athemed grouping, or a tour.

FIG. 2 is a schematic view showing four exemplary historical sites 65A,65B, 65C, 65D, each of which is identified by their respective GPScoordinates 70A, 70B, 70C, 70D (which may identify a location areacentered around particular GPS coordinates). In FIG. 2, the End User isat the first GPS coordinate 70A. When the End user moves to each of theother GPS coordinates (i.e., to each of the other historical sites 65B,65C, 65D), an audio file is played (e.g., an audio file that providesthe user with information about each particular historical site).

2.2 Challenges Faced by Current Tour Applications

2.2.1 GPS is Not Always Accurate

GPS accuracy can change based on many variables, including but notlimited to: proximity to metal objects, surrounding buildings, thenature of the GPS chip, weather conditions, atmospheric conditions,people in the vicinity of the End user, signal strength, etc.

2.2.2 Two GPS Coordinates cannot be Placed in Close Proximity

When the two or more GPS coordinates are in close proximity to oneanother, current self-guided tour systems unpredictably play audio filesdue to the lack of accuracy of the GPS systems and a lack of control bythe application on the End User's smartphone/other mobile device.

These two challenges (i.e., lack of accuracy and confusion caused byclose proximity of two or more GPS coordinates) cause the most commonerror scenario when the application on the End User's smartphone/othermobile device detects a different GPS coordinate than the actuallocation that the End User is standing at, and plays the audio fileassociated with the GPS coordinate that the application has erroneouslydetected. This is due to lack of control on the part of the applicationand a lack of accuracy on the part of the GPS system and GPS chip.

For example, FIG. 3 shows the End User U standing at a first historicalsite 65A (i.e., the Granary), however, the End User's smartphone's/othermobile device's GPS erroneously detects the End User as being locatedcloser to a second historical site 65B (i.e., King's Chapel), becauseEnd User U is located closer to the GPS coordinates for historical site65B. In this case, the audio file for location 65B (i.e., King's Chapelis played) for the End User even though End User U is actually locatedat location 65A (i.e., the Granary). End User U located at the Granaryis left very confused by the audio that is played, as the incorrectaudio is played relative to the location that the End User is actuallyvisiting.

2.3 Further Challenges

2.3.1 The End User's Walking Speed is Unpredictable

Since current self-guided tour systems merely identifies the End User'slocation based on GPS coordinates, the self-guided tour systemrecognizes only the absolute position of the End User, and does nottrack movement of the End User. Thus, such self-guided tour systems donot take into account how quickly the End User is walking betweenhistorical sites 65 (or between exhibits or other locations on thetour). An unknown walking speed creates a challenge for presentingnavigation instructions to the End User to facilitate location of thenext historical site 65 (or other exhibit/location) on the tour. And ifthe End User does not hear the navigation instructions, the End User canget lost.

Similarly, where the system only engages the End User when the End Userhas entered into an area defined by a GPS coordinate 70A, 70B, etc. as atour location, the End User often experiences long periods of silence,which can create confusion for the End User as to what they should donext (or where the End User should go).

And, where a particular audio file is associated with particular GPScoordinates 70A, the audio file may play before it is intended to (e.g.,the moment the End User enters the area defined by the GPS coordinates70A, which may be at a distance from, or out of view of, the historicalsite 65A or exhibit to which the audio file pertains), making it veryconfusing for the End User (since there is no correlation between whatthey are hearing and what they are looking at).

2.3.2 Current Tour Systems do Not Know the Orientation of the End User

Since current self-guided tour systems do not identify the orientationof the End User, it is challenging to present audio to the End Userbecause the tour system does not know which direction the End User isfacing.

If the orientation of the End User were known, a superior interactiveexperience could be provided and data (audio/video) could be presentedat a more effective time.

2.3.3 With Current Tour Systems, the End User Must Listen to CompleteAudio Files Until They Conclude

Since current self-guided tour systems do not dynamically track movementof the End User during a self-guided tour, once the audio file for aparticular location/exhibit 65A starts to play, the audio file for thatparticular location/exhibit plays until its end, unless the user movesto another, different GPS coordinate.

Thus, the approach of existing self-guided audio tour systems removes“choice” from the End User and degrades the End User's experience.

And it should also be appreciated that not all points on a tour are ofinterest to every End User, so one End User may want to listen to lessaudio and explanation concerning a particular historical site 65 (orexhibit) than other End Users.

2.3.4 The End User Must Listen to Every GPS Audio Location File

Current self-guided tour systems generally play audio for the End Userautomatically. That is, when the End User enters the area defined by GPScoordinates 70A, 70B, etc., current self-guided tour systemsautomatically play the audio for the location/exhibit 65A, 65Bassociated with those particular GPS coordinates. Hence, with existingsystems, the End User must be presented with each audio file during aself-guided audio tour.

Stated another way, with current self-guided audio tour systems, thereis no option for the End User to “opt in” as a choice to listen to aparticular audio file associated with a particular historical site 65(or exhibit).

2.3.5 Lack of IMU on Listening Device

Current systems do not provide an option to use listening devices (e.g.,headphones) comprising an IMU for inputting an End User selection duringoperation of the self-guided audio tour.

With current systems, an End User now must take their smartphone out oftheir pocket in order to interact with the tour (e.g., to make aselection such as to start or stop the tour, select an option during thetour, etc.).

The present invention allows for the End User to make a selectionwithout removing their smartphone from their pocket. By way of example,but not limitation, in one form of the invention, an IMU is provided onthe End User's headphones, and the End User may interact with the tour(e.g., to make a selection such as to start or stop the tour, select anoption during the tour, etc.) when the accompanying phone is in the EndUser's pocket by double tapping the side of the headphones (i.e., fordetection of the taps by the IMU).

2.4 How GPS Coordinate Tours are Currently Created and Delivered

The GPS coordinates 70 (and the size of the area extending about the GPScoordinates) for a particular location/exhibit 65 are typically assignedby a Tour Creator. Looking now at FIG. 4, according to currentself-guided tour systems, GPS coordinates 70 are typically assignedaccording to the following procedure:

1. The Tour Creator chooses a GPS coordinate 70 (e.g., the GranaryBurial Ground in Boston is Latitude: 42.3574|Longitude: −71.0618);

2. The Tour Creator then associates an audio file 75 with that GPScoordinate 70;

3. The GPS coordinate 70 and the audio file 75 pair (i.e., the audiofile associated with that particular GPS coordinate) are uploaded to aserver 80; and

4. When the End User is located at that GPS coordinate 70, the audiofile 75 is accessed from the server 80 and played for the End User.

2.5 The Invention: The ADT (Advanced Data Trigger) Mobile Tour DeliverySystem

2.5.1 Overview

The present invention comprises a tour delivery system that provides theTour Creator with a more precise and controlled method to create anddeliver the tour experience for the End User.

More particularly, the present invention provides the Tour Creator witha more precise and controlled method to create and deliver the tourexperience for the End User by creating a Tour Type and adding AdvancedData Trigger (ADT) locations that are associated with each theparticular GPS coordinates of each location/exhibit on the tour. The ADTis programmed with multiple control options (see below), and is alsocombined with the application controls built into the applicationrunning on the End User's personal electronic device 25 (e.g., asmartphone).

Through this process, the present invention allows the Tour Creator toproduce a more controllable, precise and interactive experience with thedata/media/audio delivery method, which also detects and utilizes theorientation of the End User.

This not only solves the issues discussed in the “challenges” sectionsabove, but it also further creates a more interactive experience for theEnd User.

2.5.2 The End User Uses Their Own Personal Electronic Device forEngaging in a Self-Guided Audio Tour

As noted above, the present invention comprises a mobile tour deliverysystem 5 that utilizes a personal electronic device 25 (e.g., asmartphone) that typically belongs to the End User. Specifically, withthe present invention, every End User has a personal electronic device25 (e.g., a smartphone/other mobile device) that has some sort ofcommunication chip(s) (e.g., the aforementioned wireless transceiver 45,the aforementioned, the aforementioned GPS receiver 50, theaforementioned Bluetooth transceiver 55, etc.) that allows the personalelectronic device 25 (e.g. a smartphone/other mobile device) to access aremote server (e.g., central server 15) hosting tour data (e.g., theaforementioned central tour database and/or tour instruction file 30).

As noted above, personal electronic device 25 (e.g., a smartphone/othermobile device) also preferably includes a 9 Axis IMU sensor (e.g., theaforementioned IMU 60) to permit personal electronic device 25 toaccurately calculate the End User's orientation. Note that the 9 AxisIMU sensor may be provided via a device in addition to a smartphone ortablet, e.g., as an IMU built into headphones or some other devicecarried by the End User (not shown). Note that for the purposes of thepresent invention, the term “personal electronic device” is intended tomean a smartphone and/or tablet and/or other mobile device (e.g.,headphones, with or without a 9 axis IMU sensor), operating individuallyor collectively, so as to provide the capabilities utilized by thepresent invention.

FIG. 5 is a schematic view showing an End User U with a personalelectronic device 25 (e.g., a smartphone/other mobile device) that isable to connect to a remote server (e.g., central server 15).

FIG. 6 is a schematic view showing the smartphone/other mobile devicefunctionalities that are preferably provided to personal electronicdevice 25 according to the present invention. The smartphone/othermobile device can detect GPS, detect IMU, retrieve relevant files from adatabase (onboard or on the server) and can play audio and/or visualfiles to the End User.

2.6 Tour Creation for the ADT Mobile Tour Delivery System

2.6.1 Step 1: Choose the Overall Tour Type

The first step in designing a novel self-guided tour according to thepresent invention is for the Tour Creator to select the type of tourthat is to be created. Listed below are exemplary novel tour optionsthat the Tour Creator is able to select from. The Tour Creator is ableto choose multiple options to be combined into one tour.

2.6.1.1 Standard Path GPS Tour

A “standard path” type of tour is a standard tour that starts at a pointA and ends at a point B, with X number of stops disposed between A andB. When designing a novel self-guided tour according to the presentinvention, the Tour Creator can select a standard path as the type oftour that is to be created.

More particularly, and looking now at FIG. 7, there is shown a standardpath 85 that has a start point A (indicated at 90) and an end point B(indicated at 95), with locations/exhibits 100A, 100B, 100C disposedbetween start point 90 and end point 95 (note that the Tour Creator maydesignate as many “stops”, i.e., location/exhibits defined by particularGPS coordinates, as the Tour Creator desires to include on the tour inbetween start point 90 and end point 95).

2.6.1.2 Loop

When designing a novel self-guided tour according to the presentinvention, the Tour Creator can select a loop as the type of tour thatis to be created. A “loop” type tour is a loop tour, e.g., for running,which allows for an additional data trigger that only plays once, i.e.,the “Introduction Data” point.

More particularly, and looking now at FIG. 8, the Loop tour optionallows the Tour Creator to create a loop tour path 105 having the sameStart point and Finish point 110. Loop tour path 105 is unique in thatit plays an Introduction audio file (i.e., a first audio file) to theEnd User at the first ADT (e.g., Start point/Finish point 110), however,when the loop is repeated (e.g., when the user completes the loop tourpath 105 and arrives back at Start point/Finish point 110), loop tourpath 105 plays a second (e.g., different) loop introduction file (i.e.,a second audio file) at the originating GPS coordinate (e.g., at Startpoint/Finish point 110). The first and second audio files are differentso that the End User does not have to listen to the introduction of howthe tour works (i.e., the first audio file) again, making the loop toura smoother experience. By way of example but not limitation, considerthe example in which the End User is running loops around the BostonCommon. The first “loop” around Boston Common would play a first audiofile to introduce the Running Tour, and the first audio file could be aminute or two in duration. During the second (or third, fourth, etc.)loop around Boston Common, the End User generally does not want to hearthe same introduction repeated, so it is replaced with the second audiofile (or a third audio file, a fourth audio file, etc.).

This feature can be included in other tour types if desired.

2.6.1.3. “Dig Deeper”

The “Dig Deeper” option is an option that allows the Tour Creator tocreate optional extensions off of a main tour path for the End User totake at their own election. The “Dig Deeper” option is preferablypresented as optional, such that if the End User is interested in theextension, the End User has to “opt in” by selecting the “Dig Deeper”extension on their personal electronic device 25 (e.g., asmartphone/other mobile device).

By way of example but not limitation, and looking now at FIG. 9,consider the Freedom Trail in Boston, Massachusetts. If the End User isengaged in a self-guided audio tour using the novel system of thepresent invention, and if the End User is walking the Freedom Trailalong a given standard path 85, and if the Tour Creator had provided theGranary Burial Ground as a “Dig Deeper” extension located between astarting point A and an ending point B, the End User could “opt in” tofollowing the “Dig Deeper” extension to the Granary Burial Ground byselecting the “Dig Deeper” extension on the End User's personalelectronic device 25 (e.g., a smartphone/other mobile device) if the EndUser is interested and wishes to spend approximately 10 minutes learningabout Paul Revere and Sam Adams at the Granary Burial Ground.Alternatively, the End User could elect to not opt in, and instead couldcontinue on the standard path 85 to the next location (ADT) 100 alongthe standard path 85.

FIG. 9 shows two exemplary “Dig Deeper” Extensions 115 that allow theEnd User to optionally take an extended route off of a standard path 85.In FIG. 9, two different “dig deeper” optional extensions 115 are shown.According to the standard path 85 shown in FIG. 9, the End User couldelect to begin walking from start point A (indicated at 90), could electto take either (or both) of the “Dig Deeper” extensions 115 disposedbetween start point A and finish point B (indicated at 95), or,alternatively, the End User could walk from the start point A and end atthe finish point B without taking either of the “Dig Deeper” Extensions115.

This feature can be included in other tour types if desired.

2.6.1.4 9 Axis IMU Sensor

The Tour Creator can also take advantage of additional options whendesigning a tour if the user's personal electronic device 25 comprisesan IMU 60 (e.g., a 9 Axis IMU sensor).

The provision of an IMU 60 allows the Tour Creator to enable morefeatures that rely on knowing the End User's orientation and whichdirection the End User is facing vis-à-vis a particular location/exhibitor the tour path.

By way of example but not limitation, the Tour Creator can useorientation information derived from IMU 60 to present data (e.g., anaudio file, text, etc.) to the End User only when the End User is facinga point of interest (i.e., when the End User's orientation is in aspecific direction). In other words, when the End User's personalelectronic device 25 (e.g., a smartphone/other mobiledevice/headphones/smart glasses, etc) comprises an IMU 60 (e.g., a 9Axis IMU sensor), the personal electronic device accesses the GPSlocation data, and the user orientation data, and then plays the audiofile associated with that particular GPS location and user orientationdata.

It should also be appreciated that, if desired, IMU 60 can be used forinteracting with the tour (e.g., for making a selection). By way ofexample but not limitation, IMU 60 may be built into the End User'sheadset (e.g., headphones, smart glasses, etc.) and the End User maymake a selection using the headset, with the End User's smartphoneremaining in their pocket. To make a selection, the End User, uponhearing a notification, touches (e.g., taps, touches, swipes, etc) theside of their headphones, smart glasses, etc. for detection by IMU 60,whereby to make a selection. The selection detected by IMU 60 could befor multiple purposes. By way if example but not limitation, theselection could be opt in to a story on the tour, or the selection couldbe to register a position the user is facing, or the selection could beto choose a file to play, or the selection could be to pause the audio,or the selection could be to skip the audio, etc. Note that multipleselections are possible through IMU detection, e.g., a single tap mayhave one meaning, a double tap may have a second meaning, etc.

This feature can be included in other tour types if desired.

2.6.1.5 Reverse Tour

The “Reverse Tour” feature is a feature that allows for the tour pathstarting and ending points to be interchangeable.

The “Reverse Tour” feature thus allows for each location/exhibit (ADT)disposed along a tour path to be accessed by the End User when the EndUser follows the tour path beginning from either end of the tour path.And it will be appreciated that the “Reverse Tour” feature allows theorder of the stops disposed along the tour path to be switched. By wayof example but not limitation, the order of the stops (i.e.,locations/exhibits/ADTs) along the tour path could be an order of1,2,3,4,5 (where each number identifies a particularlocation/exhibit/ADT). Or it could be in order of 5,4,3,2,1.

FIG. 10 shows an exemplary Reverse Tour path 120. An End User may beginReverse Tour path 120 at either start point/finish point A (indicated at125) or at start point/finish point A (indicated at 130) at the EndUser's option. If the End User starts at 125, the End User proceedsfirst to stop 100A, then from stop 100A to stop 100B, then from stop100B to stop 100C, then to end point 130. If the End User instead startsat 130, the End User proceeds first to stop 100C, then from stop 100C tostop 100B, then from stop 100B to stop 100A, then to end point 125.

This feature can be included in other tour types if desired.

2.6.1.6 Tour by Numbers

If desired, the Tour Creator can select the option to create a tour thatis guided by numbers. With this form of the invention, the tour path,and stops along the tour path, are determined based on the numbersentered into the End User's personal electronic device (e.g., in themanner of a traditional museum audio tour). To design a tour guided bynumbers, the Tour Creator associates a number value with each location(and links associated audio and/or other data with that location). Whenthe End User enters that number value, the associated audio (and otherassociated data, e.g., images) is delivered to the End User.

2.6.1.7 Explorer Tour

It should also be appreciated that, if desired, the Tour Creator couldselect a tour type that omits the tour path and instead allows the TourCreator to create a tour that does not have a tour path. By way ofexample but not limitation, this feature is advantageous for tours thatconsist of walking around a park, or telling short stories at multiplelocations.

2.6.1.7 Bluetooth Tour

The Tour creator could choose an option for a Bluetooth tour, as willhereinafter be discussed in further detail.

This feature can also be included in GPS tours, to have them play in onetour.

2.6.2 Step 2: Layout ADT GPS Coordinates and Order Numbers

Once the Tour Creator has selected the type of tour that is to becreated (e.g., standard tour path, loop tour path, reverse tour path,etc.) the Tour creator assigns the overall path of the tour between thestarting point A (indicated at 90) and the end point B (indicated at95).

FIG. 11 shows a standard path 85 with start point A (indicated at 90)and end point B (indicated at 95) chosen by the Tour Creator.

Looking now at FIG. 12, after the Tour Creator has selected the type oftour and assigned the overall path of the tour, the Tour Creator assignsGPS coordinates (or Bluetooth beacon locations or location-associatednumbers if applicable to the tour type) to each location/exhibit/ADT 100along the tour path 85 and also assigns an Order Number 135 to each stop100 (i.e., to each ADT). The Order Number 135 indicates the order inwhich the location/exhibit/ADT 100 will be presented to the End Userduring the process of the tour. During the tour, the data associatedwith the locations will be delivered in the sequence identified by OrderNumber 135. For example, arrival at stop 1 will deliver the dataassociated with stop 1, then arrival at stop 2 will deliver the dataassociated with stop 2, then arrival at stop 3 will deliver the dataassociated with stop 3. If the GPS then detects arrival at stop 5without having already detected arrival at stop 4, it will not play thedata associated with stop 5. It will search and then only deliver thedata associated with stop 4 when it is detected that the End User hasarrived at stop 4. After the data associated with stop 4 is delivered,then it will continue in sequential order, stop 5, stop 6, and so on.

At this stage, if the Tour Creator chooses the “Dig Deeper” option, theTour Creator can assign a “Dig Deeper” extension 115 (i.e., a “DigDeeper” ADT location) at any point along the tour path 85, and the TourCreator may also assign the start point of each “Dig Deeper” extension115 (not shown in FIG. 12).

FIG. 12 shows a standard path 85 tour with 4 stops 100 (i.e., 4 ADTlocations) along standard path 85. Each stop 100 (i.e., each ADT) isassigned GPS coordinates corresponding to the location of thatparticular stop 100, and an Order Number 135 corresponding to thelocation of that particular stop 100 along standard path 85 relative toother stops 100.

2.6.3. Step 3: The Tour Creator Chooses the Data Delivery Style

After the Tour Creator has selected the type of tour path (e.g.,standard tour path, loop tour path, reverse tour path, etc.) and hasassigned a starting point 90, an ending point 95 and anylocations/exhibits/ADTs 100 between starting point 90 and ending point95 (as well as the appropriate GPS coordinates and Order Number 135 foreach point on the path), the Tour Creator selects, for each stop 100(i.e., each ADT), how the Tour Creator would like to presentdata/media/audio/video to the End User. This gives the Tour Creator morecontrol over the presentation style and results in a smoother and moreinteractive experience for the End User. Exemplary choices of audiostyle are described below, but not limited to:

2.6.3.1 Play Until End

The Tour Creator selects the “play until end” option if the Tour Creatorwants the data/media/audio/video associated with the tour to play untilthe End User has completed the tour path.

The “play until end” selection tells the personal electronic device 25to not look for the next location/exhibit/ADT 100 (or GPS coordinatesfor the next location/exhibit/ADT 100) until the current audio/videoselection has completed. The data/media/audio/video associated with aparticular location/exhibit/ADT 100 of the tour is assigned to continueplaying until the system finishes presenting its data (audio/video).

2.6.3.2 Play Until Next Trigger Point

The Tour Creator selects the “play until next trigger point” option ifthe Tour Creator wants data/media/audio/video associated with the tourto play until the End User is presented with the next data trigger(i.e., the next location/exhibit/ADT on the tour).

The “play until next trigger point” selection tells the personalelectronic device 25 to continue looking for the next relevant GPScoordinate for the next location/exhibit/ADT 100 and, when found, toimmediately play the data/media/audio/video associated with thatparticular location/exhibit/ADT 100.

2.6.3.3 Navigational Overlay

The Tour Creator selects the “navigational overlay” option if the TourCreator wishes to momentarily pause the playing ofdata/media/audio/video associated with the tour in order to give the EndUser navigational instructions (e.g., “turn left,” “turn right”,“continue walking 500 feet”, etc.). With the “navigational overlay”option, the currently playing data file (i.e., thedata/media/audio/video playing for the End User) is paused, and then theNavigational Overlay plays for a short term (3-5 seconds), and then thecurrently playing data file resumes.

The “navigational overlay” option gives the Tour Creator control tonavigate the End User without the End User missing any of the content ofthe current audio/video file that is being played for the currentlocation/exhibit/ADT 100.

Thus, the Tour Creator has better controls to navigate the End Userwithout having to interrupt/miss a story-telling process.

2.6.3.4 Focus Point

As noted above, IMU 60 of personal electronic device 25 permits the TourCreator to customize various aspects of how tour data is presented tothe End User during a tour. The “focus point” feature permits a TourCreator to specify that when the End User faces an object (e.g., alocation/exhibit/ADT 100), the audio/video associated with that object(e.g., location/exhibit/ADT 100) is played by personal electronic device25. When the End User changes their orientation relative to that object(e.g., location/exhibit/ADT 100), for example, by turning to face in adifferent direction, the audio/video for that object stops playing onpersonal electronic device 25.

This is achieved by utilizing IMU 60 (e.g., a 9 Axis IMU) of personalelectronic device 25, which allows the personal electronic device 25 toknow the position/orientation of the End User relative to a particularobject (e.g., location/exhibit/ADT 100).

It will be appreciated that the “focus point” feature allows the TourCreator to specify the playing of audio/video files only when the EndUser is facing a particular object.

It will also be appreciated that the “focus point” feature also allowsthe End User to “opt out” of any audio/video files they are notinterested in by simply changing their orientation relative to theobject (e.g., location/exhibit/ADT 100).

2.6.3.5 Notification Point/Opt in Notification

The “notification point” feature alerts the End User that there is anstop 100 (i.e., an ADT) where they are currently located, and the EndUser has the option to “opt in” to receiving the data associated withthat stop 100 (i.e., the data associated with that ADT), with the usergetting the audio/video data by performing an action using theirpersonal electronic device, on their smartphone, headphones, smartglasses, etc., 25, e.g., pressing a button, double-tapping display 35 ofpersonal electronic device 25, etc.

The “notification point” option gives the End User greater control overtheir experience and give them choice.

This Action could be performed on headphones with an embedded IMUsensor. The IMU sensor would pick up actions such as touch, gestures,tapping, pressing a button or other actions. In this case, the end userwould be able to keep their smartphone in their pocket and interact withthe tour by only performing an action on their headphones, smartglasses,etc.

By way of example but not limitation, imagine if the End User isstanding in front of a painting and then hears a short intro. They heara notification letting the End User know that they can hear an expandedstory about the painting. The End Users phone is in their pocket. Theyare wearing headphones. If the End User is interested, they can “opt in”to listening to the story by performing the said action, if the End Useris not interested, they can do nothing and they will not get theaudio/video of the story.

In this case the end user touches their headphones to opt in. With thataction, the next data plays, in this case, the expanded story of thepainting.

2.6.3.6 Spatial Point

The “spatial point” feature allows the audio that is delivered to theEnd User during a tour to sound like it is coming from a specificlocation, for example, from a statue. If the user turns around, theaudio sounds as if it is coming from behind the user.

The “spatial point” feature gives depth to the experience of the tourfor the End User, and makes the audio feel more like it is coming from adifferent source.

2.6.3.7 Guide Point

The “guide point” feature gives the End User the feeling of a guidespeaking over the End User's shoulder.

In addition, each point would have location-specific data added to it.For each point, the Tour Creator would add location-specific data, byway of example including, but not limited to:

-   -   1. Image or video for the location;    -   2. Dialogue showing the text that is spoken;    -   3. Choice of translation, so each dialogue is translated in        multiple languages; and    -   4. Choice to have the dialogue text generated machine read        audio.

It should be appreciated that, with all these factors, each location isthe mentioned ADT (Advanced Data Trigger). As discussed above, thisincludes the GPS point, the Sequential Order Number (if applicable), theaudio style and the additional data that is presented.

2.6.4 Completed Tour is Loaded to Server

Once the Tour Creator has completed the process designing a tour, theywill have a complete tour with a starting point 90, an end point 95, atour path 85, and one or more location/exhibit/ADTs 100A, 100B, etc.built in. An exemplary tour is shown in FIG. 13.

More particularly, FIG. 13 shows a Standard Tour path 85 having astarting point A (indicated at 90), an end point B (indicated at 95) anda tour path extending from A to B with 4 location/exhibit/ADTs 100A,100B, 100C, 100D disposed along the tour path, each of whichlocation/exhibit/ADT has an order number 135 assigned to it, as well asa particular file and data delivery style attached (i.e., assigned) toit.

Once the Tour Creator has completed designing the tour, the tour can beuploaded to a server (e.g., from the aforementioned computer 10 tocentral server 15) and made accessible to End Users through theapplication on the End User's smartphone/other mobile device.

Note that the Tour Creator may alternatively utilize software stored oncentral server 15 (e.g., a web-based application) to design the tour, inwhich case the tour is both designed on and stored on central server 15(without requiring upload from the Tour Creator's computer 10). And thecompleted tour may be stored in tour database 20 in the form of tourinstruction file 30 to facilitate easy searching and locating of thecompleted tour (e.g., by End Users).

2.7 Exemplary Use

In an exemplary use, the End User runs an application on their personalelectronic device 25 (e.g., a smartphone/other mobile device) whichdownloads or streams a selected tour instruction file 30 for aparticular tour and plays an advanced data trigger mobile tour for aparticular site (i.e., begins a self-guided audio tour specific for thedesired location). By way of example but not limitation, the End Usermight play a self-guided audio tour for the Freedom Trail in Boston,Mass. As the End User moves about, personal electronic device 25 (e.g.,a smartphone/other mobile device) monitors the GPS coordinates ofpersonal electronic device 25 (and hence the location of the End User)and the orientation of the End User, playing the appropriate audio filestyle and data associated with each particular GPS location and End Userorientation.

3. Advanced Data Trigger Mobile Tour Delivery System—BluetoothApplications

3.1 Overview

Bluetooth Beacon tours (i.e., Bluetooth-based tour applications) havetheir own challenges which can benefit from the novel Mobile TourDelivery System 5 discussed above.

The present invention comprises a tour delivery system that provides aTour Creator with a more precise and controlled method to deliver a tourexperience to an End User than prior art approaches. As discussed indetail in the section above, the mobile tour delivery system 5 createsAdvanced Data Trigger (ADT) location points (i.e., locations/exhibits100) using GPS coordinates associated with each location/exhibit/ADT.The present invention also enables the mobile tour delivery system 5 tocreate Advanced Data Trigger (ADT) location points (i.e.,location/exhibit/ADTs 100) associated with Bluetooth Beacon Locationsrather than (or in addition to) GPS coordinates.

The Advanced Data Trigger (ADT) Mobile Tour Delivery System isprogrammed with multiple control options (see above) and is alsocombined with the application controls built into the mobile applicationrunning on the End User's smartphone/other mobile device.

Through this process, the invention allows the Tour Creator to produce amore controllable, precise and interactive experience with thedata/media/audio delivery method, which detects and utilizes theorientation of the End User.

The following section adds additional subject matter to encompassBluetooth Beacon technologies into the use of the Advanced Data TriggerMobile Tour Delivery System discussed above.

This not only solves the issues discussed in the “challenges” sectionsbelow, it also creates a more interactive experience for the End User.

3.2 Background

A Bluetooth Beacon is a device which utilizes a limited-range wirelessconnection to facilitate “homing in” on the Bluetooth Beacon using aBluetooth enabled device. The Bluetooth transceiver 55 of personalelectronic device 25 may be configured to connect to a Bluetooth Beaconso as to enable personal electronic device 25 to provide instructions tothe End User to facilitate movement towards (or away from) a particularBluetooth Beacon. Since a Bluetooth Beacon relies on a short-range radiosignal that is relatively unaffected by surrounding objects and does notrequire satellite guidance (unlike GPS), a Bluetooth Beacon isparticularly well-suited for indoor applications where it is notpossible to receive a GPS signal, or applications in which exhibits areclose together.

By way of example but not limitation, if an End User visits a locationwith a Bluetooth Beacon-enabled tour (e.g., a museum) and the End Userwants to take a tour of that location, the End User has an option of aself-guided audio tour that can be played on the End User's personalelectronic device 25 (e.g., a smartphone or other mobile device such asa tablet). The personal electronic device 25 (e.g., a smartphone/othermobile device) has connectivity to WiFi/Cellular/GPS/Bluetooth asdiscussed above (i.e., via wireless transceiver 45, via GPS receiver 50and via Bluetooth transceiver 55).

The End User can download a mobile application to their personalelectronic device 25 (e.g., their smartphone/other mobile device) thatcan be used to guide the End User to specific locations (e.g., 18thcentury paintings).

Each location of interest is assigned a Bluetooth Beacon and a name forthe point of interest (e.g., the Mona Lisa).

With the mobile application, when the smartphone/other mobile device ofthe End User acquires the Location Signal from the Bluetooth Beacon(e.g., the location of the Mona Lisa via the Bluetooth Beacon signal) anappropriate audio file is played on the End User's personal electronicdevice 25 (e.g., their smartphone/other mobile device) via the mobileapplication.

The mobile application on the smartphone/other mobile device could havemultiple locations (each of which has its own Bluetooth Beaconassociated to it) for the End User to follow in a group. This groupingthen makes the End User a themed grouping or a tour path, such as theaforementioned standard tour path 85.

FIG. 14 shows four exhibits (e.g., paintings) 140A, 140B, 140C, 140Dwith their associated Bluetooth Beacon Locations 145. The End Userbegins at the first Bluetooth Beacon Location 140A. When the End Usermoves to each subsequent Bluetooth Beacon Location 140B, 140C, 140D, anaudio file specific to each of those Bluetooth Beacon Locations 140B,140C, 140D is played.

3.3 Challenges Faced by Current Bluetooth-Based Systems (The Prior Art)and the Solutions Provided by the Advanced Data Trigger (ADT) MobileTour Delivery System

Below are described a limited number of examples that create challengeswhen using Bluetooth Beacon technology for Tours, and describes how thechallenges can be solved by using the system of the present invention.

3.3.1 The Tour Creator is Unable to Have Multiple Exhibits (i.e.,Exhibits which Each Have Their Own Bluetooth Beacon Associated with it)in Close Proximity to One Another in a Tour

If locations/exhibits/ADTs (i.e., the exhibits on the tour) are locatedtoo close to one another they will trigger other Bluetooth BeaconAudio/Video files. While there is more control over the triggerdistance, this approach still has limits.

FIG. 15 shows four exhibits (i.e., 4 paintings) 140A, 140B, 140C, 140Dlocated in close proximity to one another. In the scenario depicted inFIG. 15, the exhibits (i.e., the paintings) are too close to oneanother, i.e., the Bluetooth Beacon triggering areas 150A, 150B, 150C,150D overlap due to the close proximity of each of the exhibits (i.e.,the paintings).

With current (prior art) self-guided tours, it is not possible to createa tour including each of the paintings because the Tour Creator would beunable to control the Audio/Video files from being triggered atinappropriate times due to the overlapping Bluetooth Beacon triggeringareas 150A, 150B, 150C, 150D.

3.4 The Invention: Advanced Data Trigger Mobile Tour DeliverySystem—Bluetooth Applications

The system of the present invention is able to solve the aforementionedproblem through multiple methods.

One way to address the aforementioned problems with the use of BluetoothBeacons is for the Tour Creator to choose Data Delivery Styles (seeabove) for individual Bluetooth Beacon Locations. For example, the TourCreator may choose a Bluetooth Beacon Location that is set to “Playuntil End” which enables the audio/video file associated with thatBluetooth Beacon Location to play until the end of the audio/video fileso that the mobile application is not looking for the next BluetoothBeacon Location on the tour path until the audio/video file associatedwith the first Bluetooth Beacon Location has completed playing. Once theaudio/video file is finished playing, the mobile application (i.e., theapplication running on personal electronic device 25) looks for the nextBluetooth Beacon Location on the tour path. With this Data DeliveryStyle, the End User is able to listen/retrieve all the data associatedwith each Bluetooth Beacon Location, if desired.

The Tour Creator is also able to make “opt in” choices for particularexhibits (e.g., paintings) by choosing the aforementioned Data DeliveryStyle “Notification Point”. For this Data Delivery Style, the End Userreceives Notifications from the mobile application running the Tour onthe End User's personal electronic device 25 (e.g., a smartphone/othermobile device). By way of example but not limitation, the Notificationmay say the painting's name as the notification, such as “Mona Lisa”. Ifthe End User wants to listen/view the audio/video file associated withthe notification, the End User can “opt in” by performing an action onpersonal electronic device 25, such as double tap or click. Once the EndUser “opts in”, the Data Delivery Style for the audio/video file may beconfigured as “Play to End” so that the audio/video file plays until theend without triggering another Bluetooth Beacon Location. Each BluetoothBeacon Location is assigned an order for triggering. This way eachBluetooth Beacon Location is presented in the order specified by theTour Creator.

FIG. 16 shows an example where each Bluetooth Beacon Location 145A,145B, 145C, 145D is assigned an order number 135 and Data Delivery Styleby the Tour Creator, e.g., “Play until End” and/or “Notification Point”.This enables the Tour Creator to present items in close proximity to oneanother without triggering Audio/Video files at inappropriate times.

3.4.1 The End User Cannot “Cross Over” Other Bluetooth Beacon Locations

If the End User crosses over another Bluetooth Beacon Location 145(e.g., from a first Bluetooth Beacon Location 145A to a second BluetoothBeacon Location 145B) the Bluetooth Beacon Location for the secondlocation is triggered and the audio/video file associated with thatBluetooth Beacon Location will play. This makes Bluetooth BeaconLocations less convenient and less controllable, and thus less likely tobe used by a Tour Creator when creating a tour.

By way of example but not limitation, as shown in FIG. 17, the TourCreator cannot create a tour where the End User needs to walk throughBluetooth Beacon Location 145B (indicated at 3 in FIG. 17) in order togo to Bluetooth Beacon Location 145C (indicated at 2 in FIG. 17), sincethis would trigger Bluetooth Beacon Location 145B.

The Advanced Data Trigger (ADT) Mobile Tour Delivery System of thepresent invention is able to solve this problem by using the DataDelivery Style “Play Until End” for one or more of the Bluetooth BeaconLocations 145A, 145B, 145C, and by assigning order numbers 135 to theBluetooth Beacon Locations. This allows the End User to “cross over”Bluetooth Beacon Locations to reach other Bluetooth Beacon Locationswithout triggering them.

3.4.2 The Tour Creator does Not Know the Orientation of the End User

The lack of control over the orientation of the End User makes a tourmore complicated for the Tour Creator to present to the End User.

This also makes a tour less interactive for the End User.

The system of the present invention solves this problem by using theAudio Style Choice “9 Axis IMU Sensor” which is facilitated using IMU 60of personal electronic device 25. The Audio Style Choice “9 Axis IMUSensor” (i.e., the provision of an IMU 60) allows the Tour Creator tohave control over how the tour is delivered to the End User dependingupon the orientation of the End User (i.e., which way the End User isfacing) so as to present Audio/Video files for Bluetooth BeaconLocations to the End User in a more interactive and informationalfashion.

3.4.3 The End User Cannot “Opt in” to Audio/Video Files

With existing self-guided audio tours, once the End User enters aBluetooth Beacon Location, the audio/video is forced played on themobile application. That is, the End User does not have the option to“opt in” to listening to the audio/video.

The system of the present invention solves this issue by using theaforementioned Data Delivery Style “Notification Point”. The“notification point” feature plays a short audio sound to let the EndUser know that there is a Bluetooth Beacon Location 145 present and thatthe End User can be presented with an Audio/Video file, but the End Usermust perform an action on their personal electronic device 25 in orderto “opt in”, e.g., press a button on their smartphone, or double tap orperform an action on their headphones, smart glasses or other device.

3.4.4 Unable to Play Long Audio/Video Files without the End UserPotentially Getting Lost

With existing self-guided audio tours, if another audio/video file ispresented during the tour, the mobile application stops playing the longaudio/video file.

If the audio/video file plays, then it is complicated to give directionsto the End User since the Tour Creator does not know exactly where theEnd User is standing at that point in time.

This is solved by the present invention with the aforementioned DataDelivery Style “Play until End” with “Navigational Overlays” to directthe End User (see above).

More particularly, the Advanced Data Trigger (ADT) mobile tour deliverysystem of the present invention solves this issue by using an additionalData Delivery Style, the aforementioned “Navigational Overlays” feature(see above). With the “Navigational Overlays” Data Delivery Style, ifthe End User needs directions, the audio/video file is paused, andnavigation directions are given to the End user; once the directionshave been given to the End User, the original audio/video filere-commences.

4. ADT Mobile Tour Publishing Platform

4.1 Background

As noted above, in one preferred form of the invention, the Tour Creatorcreates a self-guided tour on a web-based Tour Developer application andpublishes it (i.e., stores the tour instruction file 30 in tour database20 on central server 15). The Tour (i.e., tour instruction file 30)resides on a server (i.e., central server 15) that pushes the Tour to amobile application running on a smartphone/other mobile device where EndUsers can download and access the Tour.

FIG. 18 shows current (prior art) Tour Developer Web Applications thatallow Tour Creators to publish a Tour to a mobile application. Notehowever, that current (prior art) Tour Developer Web Applications onlyallow the Tour Creator to publish the Tour to one (i.e., a single)mobile application (e.g., a proprietary mobile application).

4.2 Challenges Faced with Current (Prior Art) Tour Developer WebApplications

Prior art self-guided tour developer web applications and means ofdelivery of self-guided tours suffer from significant drawbacks. By wayof example but not limitation, current (prior art) publishing platformsdo not allow the Tour Creator to publish their Mobile Tour(GPS/Bluetooth) as an integrated feature section on an existing mobileapplication (e.g., a branded company mobile application, such as ahotel, running, travel, airline mobile application).

More particularly, with prior art publishing platforms, the Tour Creator(e.g., a company) cannot publish directly to their mobile application.By way of example but not limitation, consider the case of a large hotelchain. Such a large hotel chain (i.e., the “Tour Creator”) may like toleverage the investment of their mobile application by adding thefeature of a self-guided tour that the End User (e.g., a hotel guest)can download and run using the large hotel chain's existing mobileapplication (i.e., to integrate the Mobile Tour on the hotel chain'spreexisting mobile application).

However, current (prior art) publishing platforms only publish to onedestination (i.e., one mobile application). This creates issues for theTour Creator, who may wish to publish the self-guided tour (i.e., theMobile Tour) to multiple mobile applications, such as an existingcompetitor tour application and to the Tour Creator's own existingapplication (e.g., a branded mobile application of a company such as alarge hotel). For the Tour Creator to publish the self-guided tour(i.e., the Mobile Tour) to a different mobile application wouldtypically incur a high cost in expenses, and increased time indevelopment, as the Tour Creator needs to customize the tour to enableit to be published to a different mobile application.

4.3 The Invention: ADT Mobile Tour Publishing Platform

The present invention addresses the issued discussed above by enabling aTour Creator to publish a self-guided tour (i.e., the Mobile Tour)quickly and easily to multiple (i.e., different) mobile applications.

More particularly, with the present invention, once the Tour Creator hascreated a Tour (i.e., in the manner discussed above) the Tour Creatorwould be presented with publishing options.

The “publishing options” presented to the Tour Creator include, but arenot limited to the following publishing options.

4.3.1. Publishing to Existing Third-Party Applications

The Tour Creator may publish the self-guided audio tour through anapplication programming interface (API) to a designated feature sectionon an existing mobile application (e.g., an airline, hotel, travelcompany mobile application). This permits integration of the self-guidedaudio tour with a company's existing mobile application, allowing forsupport of the publication of Tours to that existing mobile application.The existing mobile application is then able to process the tour dataand deliver the self-guided tours (i.e., through the company's mobileapplication) as published from the system of the present invention.Integration with a company's existing mobile application is effected by:

(a) Giving the Tour Creator access to a development tool (which issometimes hereinafter referred to as the “Tour Developer WebApplication”); and

(b) providing an easy integration to with an existing mobileapplication, enabling it to process and run the pushed Mobile Tour datagenerated by the Advanced Data Trigger (ADT) Mobile Tour DeliverySystem.

The present invention facilitates connecting a Mobile Tour Section oftheir mobile application through an API to the Mobile Tour Data Server(i.e., central server 15).

The Mobile Tour Data Server (i.e., central server 15) then pushes thecreated content to the API of the existing mobile application. Thisarrangement enables the Mobile Tour data (i.e., tour instruction file30) to run on the existing mobile application. This allows for the fullfunctionality of the Advanced Data Trigger (ADT) Mobile Tour DeliverySystem to be utilized through the existing mobile application.

Overall, this approach saves a large amount of development resources forthe organization (e.g., a large company, hotel, etc.) having existingmobile applications. Such an organization (e.g., a large company, hotel,etc.) is able to launch self-guided tours quickly, without losing theorganization's investment in developing and promoting their existingmobile application. Third-party existing mobile applications have accessto the features described above. This approach allows the Tour Creatorto quickly, easily and economically offer tours as a feature of theirexisting mobile application, whereas with prior art approaches, offeringtours was time-consuming and expensive to create and publish MobileTours through their existing mobile application. It will be appreciatedthat the novel approach of the present invention allows third parties toleverage further marketing and promotions to drive more traffic to theirexisting mobile application. All data “pushed” from the Mobile Tour DataServer (i.e., central server 15) instantly appears in the existingmobile application (i.e., the third-party mobile application), enablingEnd Users to run tours off of the existing mobile application. TheMobile Tour Data (i.e., tour instruction file 30) is stored in thecentral server (i.e., central server 15) which has the ability to “push”the Mobile Tour data (i.e., tour instruction file 30) to the existingmobile application.

4.3.2 Publishing to a Proprietary Mobile Application

The present invention also allows the Tour Creator to publish Tours(e.g., self-guided audio tours) to a general public mobile applicationthat holds all submitted tours. It is a main hub for tours that acceptstours from all publishers. This general public mobile application may becalled “WalknTours”.

4.3.3 Publish to a Stand-Alone Mobile Application

The present invention also allows the Tour Creator to publish Tours to amobile application that is customized for any organization and permitsthe Tour Creator to only publish tours the Tour Creator has created forthat organization.

FIG. 19 shows that the Tour Developer Web Application (i.e., theapplication used by the Tour Creator to create a self-guided tour usingthe Tour Creator's computer 10) which provides the ability to publishTours to multiple locations (i.e., multiple servers, including centralserver 15). In the example shown in FIG. 19, the Tour Developer WebApplication publishes to three locations: (i) a general public mobileapplication (“WalknTours”), (ii) a customized mobile application (i.e.,where the Tour Creator publishes to the Tour Creator's own, proprietary,mobile application), and (iii) publication to a Mobile Tour Section ofan existing mobile application through an API (i.e., the API “pushes”the tour to an existing mobile application). The End User then accessesthe Tour through the existing mobile application on their phone (whichcould either be the general public mobile application (“WalknTours”), acustomized mobile application, or a Mobile Tour Section of a mobileapplication). All of these approaches offer the same experience, albeitthrough different mobile applications.

5. Interactive Augmented Reality Data Delivery Style Choice Options forAdvanced Data Trigger Mobile Tour Delivery System—GPS/Bluetooth

5.1 Background—Current State of Audio Tours

As discussed above, self-guided audio tours are known in the art. Withsuch prior art self-guided audio tours, visitors to a new city or museumhave an option to take an application-based audio tour that can beplayed on the End User's smartphone or other mobile device (e.g., atablet). Such application-based self-guided audio tours can bedownloaded onto the End User's smartphone or other mobile device (e.g.,a tablet). When the application is used, the application triggers audiofiles that are played at a specific location determined using GPScoordinates or Bluetooth Beacon Locations.

With prior art self-guided audio tours, the audio files that are playedare “static” Audio files, meaning that the audio is presented much likeone would hear on a podcast, the radio, a song, or any other audio thatlistened to on a daily basis. In other words, the audio played duringcurrent audio tours is played with no interaction on the part of the EndUser.

5.2 Challenges Faced by Current Audio Tours

There are multiple issues with the current state of self-guided Audiotours, as will hereinafter be discussed in further detail.

Current audio tour applications do not utilize an IMU, and hence areunable to detect and utilize the orientation of the End User. Thus,current audio tour applications do not know the orientation of the EndUser (i.e., which direction the End User is facing) when the End User isengaged in the tour.

Since current audio tour applications do not utilize an IMU and hence donot know the orientation of the End User when the End User is engagingin a tour, current audio tour applications are unable to create anddeliver “dynamic” (i.e., spatial) audio/data experiences. The presentinvention improves upon current audio tour applications that do notprovide options for “dynamic” (spatial) audio in current applications byutilizing the aforementioned IMU 60 to determine the End User'sorientation while the End User is engaged in a tour, thereby allowingfor interactive experiences for the End User. Such “dynamic” (spatial)audio/data experiences could be considered Audio Augmented Reality. Withthe present invention, the audio interacts with the End User as if itwere reality, but changes the nature of the interaction based on the EndUser's behavior and orientation. Thus, a significant limitation of priorart current audio tour application is that the End User is unable tointeract with the tour experience (i.e., the End User has no options to“opt in” and no interactive experiences).

5.3 The Invention: Interactive Augmented Reality Data Delivery StyleChoice Options for Advanced Data Trigger Mobile Tour DeliverySystem—GPS/Bluetooth

The present invention comprises audio delivery styles which may beprovided as choices/options in the Advanced Data Trigger Mobile TourDelivery System of the present invention discussed above. The audiodelivery style choices are sometimes referred to herein as “DataDelivery Styles”.

The innovative Data Delivery Styles provide new features during a mobiletour that enable several new and improved ways of delivering audioduring a self-tour.

5.3.1 Interactive Augmented Reality

The present invention allows a Tour Creator to develop interactiveAugmented Reality experiences. More particularly, with the interactiveAugmented Reality experiences of the present invention, the Tour Creatorcan: know the orientation of the End User (e.g., via the aforementionedIMU 60 of an End User's personal electronic device 25), and cancalibrate the End User's orientation with the IMU 60 (e.g., with a 3/6/9axis IMU sensor or other relevant sensors, such as the aforementionedIMU 60) of personal electronic device 25, e.g., a smartphone and/orother mobile devices (e.g., a tablet) that can collect this data. TheTour Creator can then place Dynamic (Spatial) Audio trigger locations inmultiple orientations (i.e., left/right/forward/back) and distances(i.e., 5 feet or 50 feet) relative to a location/exhibit vis-à-vis theEnd User. Additionally, the Tour Creator can place multiple Dynamic(Spatial) Audio/Data trigger Points in one location (GPS/Bluetooth) andcontrol the order that the trigger Points are presented to the End User.

5.3.2 Audio Augmented Reality

The present invention also allows the Tour Creator to develop audioaugmented reality experiences. The audio augmented reality experiencesfeature allows the End User to have Audio Augmented Reality experienceswhen interacting with GPS coordinates and/or Bluetooth Beacon locationsduring a tour.

By way of example but not limitation, an audio augmented realityexperience may allow the End User to hear dynamic (spatial) audio, e.g.,the audio would sound as if it is coming from the left of the End User,when the End User turns to look, now it sounds as if the audio is comingfrom in front of the End User, and when the End User turns around itsounds as if the audio is behind the End User. By way of further examplebut not limitation, and audio augmented reality experience may allow thevolume of the audio delivered to vary according to how far the End Useris located from a location/exhibit, e.g., if the End User walks closerto the sound it grows louder. In other words, the audio has an actualpositioning.

5.3.3 Interact with the Tour Experience

The present invention also allows the Tour Creator to develop audioaugmented reality experiences that permit interaction between the EndUser and a particular location/exhibit. By way of example but notlimitation, the tour may be configured by the Tour Creator such that ifthe End User looks at a point, for example, at a statue (i.e., anexhibit), the audio will play, and if the End User looks away from thestatue (i.e., the exhibit) the audio stops playing. If desired, the TourCreator can configure the tour such that the End User can “opt in” totour experiences by double tapping on their personal electronic device25 (e.g., a smartphone and/or other mobile device such as a tablet,headphones, etc.). Furthermore, if desired, the Tour Creator canconfigure the tour such that the End User can change their orientationand then interact with the audio.

5.4 Interactive Augmented Reality Data Delivery Style Choice Options

Below are the descriptions of each Data Delivery Style of the AdvancedData Trigger Mobile Tour Delivery System that may be used with thepresent invention.

5.4.1 Dynamic (Spatial) Audio Positioning

Using personal electronic device 25 (e.g., a smartphone and/or othermobile device such as a tablet, headphones, etc.), the present inventionuses IMU 60 (e.g., a 3/6/9 axis IMU sensor or relevant sensors) of thepersonal electronic device 25 (e.g., a smartphone and/or other mobiledevice such as a tablet, headphones, etc.) to detect the orientation ofthe End User vis-à-vis a location/exhibit specified on a tour.

Knowing the orientation of the End User enables placement of dynamic(spatial) audio files for specific orientations of the End User. Thesedynamic (spatial) audio files include: Left, Right, Behind, In front

5.4.2 Create Augmented Reality Experiences

As noted above, the Tour Creator can configure the tour such that theaudio delivered to the End User varies depending on the End User'smovement relative to a specific location/exhibit.

By way of example but not limitation, the tour can be configured suchthat if the End User hears a voice to their left and the End User:

-   -   1. Turns left, then the voice is heard as if it were in front of        the End User        -   a. And if the End User walks forward (i.e., toward the            voice) the voice gets louder    -   2. Turns right, then the voice is heard as if it were behind the        End User        -   a. And if the End User walks forward (i.e., away from the            voice) the voice gets softer    -   3. Turns around (i.e., 180 degrees), the voice is heard as if it        were to the End User's right

The Advanced Data Trigger Mobile Tour Delivery System of the presentinvention is able to deliver audio in multiple directions byimplementing an order placement as discussed above. Each audio fileheard by the End User is assigned a GPS/Bluetooth Location. In thiscase, there may be many audio files that are provided at the samelocation. Using an order placement scheme enables control over thedelivery of multiple dynamic audio files during one tour experience.

The Tour Creator is able to “place” (i.e., situate) Dynamic (spatial)Audio experiences based on the orientation of the End User relative to aparticular location/exhibit so as to control the experience anddirection that they are orientated in and interacting in. The TourCreator can also control the flow of the presented dynamic audio usingthe Advanced Data Trigger Mobile Tour Delivery System of the presentinvention.

The Tour Creator can also create Audio Augmented Reality experiencesanywhere that has a GPS signal or Bluetooth Beacon. The resulting tourexperience for the End User is that the End User hears audio augmentedreality and interacts with it based on their orientation relative to aparticular location/exhibit.

FIG. 20 shows the End User with personal electronic device 25 (e.g., asmartphone or other mobile device) and acoustic output means 40 (e.g.,headphones) at a single GPS location 155. Using the present invention,Tour Creator can configure the tour such that the End User is presentedwith 4 data/audio trigger files 160A, 160B, 160C, 160D in one location(i.e., GPS location 155). Each data/audio trigger file 160A, 160B, 160C,160D is presented from a different dynamic spatial direction (i.e., eachdata/audio trigger file is configured to sound as if it is being emittedfrom a different spatial direction) based on the orientation of the EndUser. Each data/audio trigger file 160A, 160B, 160C, 160D plays insequence (i.e., according to the order number assigned), and with theinteraction of the End User with the application on their mobile device.

5.5 GPS Dynamic (Spatial) Audio Positioning

As noted above, the present invention permits a Tour Creator toconfigure a tour such that dynamic (spatial) Advanced Data Triggers(ADTs) are placed at a particular GPS Coordinate. When this feature isutilized, the tour is configured such that when the End User enters thetrigger area of the GPS coordinate, an audio file is played. This isachieved by using the personal electronic device 25 (e.g., a smartphoneand/or other mobile device such as a tablet, headphones, etc.) of theEnd User. The present invention uses the aforementioned IMU 60 (e.g., a3/6/9 axis IMU sensor), and/or other relevant positioning sensors, todetect the orientation of the End User. Using the GPS receiver 50 ofpersonal electronic device 25, the End User's position (i.e., GPScoordinates) is known and the End User's position is calibrated. The EndUser's orientation relative to the GPS coordinate is gathered from thecalibrated position.

Knowing the End User's orientation allows for the creation of dynamic(spatial) audio experiences around their specific orientation.

5.5.1 Create Augmented Reality Experiences

As noted above, the Tour Creator can configure the tour such that theaudio delivered to the End User varies depending on the End User'smovement relative to a specific location/exhibit.

By way of example but not limitation, the tour can be configured suchthat if the End User hears audio configured as a voice to the End User'sleft and the End User turns left, the voice is heard as if it were infront of the End User (i.e., the End User is now facing the sound of thevoice). And if the End User walks forward, the voice gets louder. If theEnd User turns right, the voice is behind them. And if they walk forward(i.e., away from the sound of the voice), the voice gets softer. Now, ifthe End User turns around (i.e., 180 degrees), the voice is to theirright.

By way of example but not limitation, consider a tour configured suchthat a dynamic (spatial) GPS Coordinate is located at the Sam AdamsStatue in Boston, Mass. and the End User is standing 50 feet directly infront of the statue. If the End User moves forward, the audio that isplayed for the End User gets louder. If the End User turns left the EndUser hears the audio as if the audio is coming from their right. If theEnd User turns around, the audio sounds as if it is coming from behindthe End User. If the End User moves away from the statute, the audioheard by the End User becomes softer.

As discussed above, it is also possible for the Tour Creator toconfigure the tour such that different audio files are delivered to theEnd User from multiple directions by implementing an order number asdiscussed above. Where this feature is utilized, each audio file heardis assigned a GPS/Bluetooth Location. In this case there may be manyaudio files that are at the same location (e.g., four differentdata/audio trigger files 160A, 160B, 160C, 160C as shown in FIG. 20, ora different number of data/audio trigger files). Using an orderplacement of the triggers, the present invention is able to control thedelivery of multiple dynamic audio files in one tour experience. Theresulting experience is that the Tour Creator is able to place dynamic(spatial) Audio experiences at GPS coordinates or Bluetooth Beaconlocations, and using the orientation of the End User (i.e., asdetermined by IMU 60 discussed above) the present invention allows theTour Creator to interact with the Audio Augmented Reality experience soas to control the flow of the presented dynamic audio using the AdvancedData Trigger Mobile Tour Delivery System, and to create Audio AugmentedReality experiences anywhere that has GPS signal or Bluetooth Beacons.

The resulting experience for the End User is that the End User hearsaudio augmented reality and interact with it based on their orientation.This feature can make inanimate objects feel as if they are “alive”(i.e., “dynamic”).

5.5.2 “Opt in” to the Tour Experience—Notifications

If desired, the data/audio trigger files may be configured by the TourCreator such that when the End User arrives at a specified GPScoordinates or Bluetooth Beacon location, the End User is presented withan audio notification. By way of example but not limitation, when theEnd User arrive at specified GPS coordinates or Bluetooth Beaconlocation for a Leonardo Da Vinci exhibit, such an audio notificationcould say “double tap now to learn more about Leonardo Da Vinci”. Whenthe End User performs an action (e.g., double tapping display 35 ofpersonal electronic device 25), then the second set of data/audio fileswould be played for the End User. In the foregoing example, such secondset of data/audio files may be the full story about Leonardo Da Vinci.

Alternatively, where such a data/audio trigger is activated by the EndUser (e.g., by the End User arriving at the specified GPS coordinates orBluetooth Beacon location), the End User has the option of not “optingin”, and instead just walking on (i.e., continuing along the tour path).This may be a helpful feature for use in a museum where there are manypaintings, however, the End User is not interested in hearing a secondset of data/audio files about all of the paintings. That is, the EndUser may only “opt in” to the locations that the End User is interestedin.

The Tour Creator can use various types of triggers to allow the End Userto “opt in” to the optional audio experience. Some exemplary triggersinclude: the End User “Double Taps” their headphones, the End Usershakes their personal electronic device 25 (e.g., a smartphone and/orother mobile device), the End User presses the camera button on theirpersonal electronic device 25 (e.g., a smartphone), and otherinteractive experiences that do not require opening/unlocking thepersonal electronic device 25 (e.g., a smartphone and/or mobile device)may also be provided

5.6 Focus Point Augmented Reality Dynamic (Spatial) Audio

When the End User enters a GPS coordinate or Bluetooth Beacon locationthe Tour Creator can configure the tour program such that the End Usertriggers an audio file that can only play when they are looking in asingle (specified) direction. By way of example but not limitation, ifthe tour specifies that an audio file plays when the End User looks at aparticular painting, the audio/data file plays when the End User islooking at the painting (i.e., when the End User is oriented so as to befacing the painting). If the End User looks away from the painting(i.e., the orientation of the End User is changed relative to thepainting), then the audio/data file plays at a lower volume until at aset angle (e.g., 45 degrees, full left turn relative to the painting),at which it stops playing. If the End User looks back at the painting(i.e., is oriented so as to face the painting again), the audio startsto play again. If the End User turns and walks away from the painting,the audio softens. If the End User approaches the painting, the audiogrows louder.

As discussed above, using the personal electronic device 25 (e.g., asmartphone and/or other mobile device such as, a tablet, headphones,etc.) of the End User, the present invention uses the IMU 60 (e.g., a3/6/9 axis IMU sensor), and other relevant positioning sensors, todetect the orientation of the End User. This feature permits the TourCreator to customize the delivery of audio files depending upon theorientation of the user relative to a location/exhibit. When utilizingthis feature, the End User's position is calibrated as discussed above,the End User's orientation/direction they are facing is gathered fromthe calibrated position, and once the End User's orientation is “lockedin” (i.e., recognized), the End User's orientation is used to trackwhere and how much the End User moves.

5.6.1 Create Augmented Reality Experiences

As discussed above, the present invention allows the Tour Creator todesign a tour such that the End User is able to interact with inanimateobjects, i.e., paintings, statues, walls, etc. during the tour. Theresulting experience is that the Tour Creator is able to place dynamic(spatial) Audio experiences at GPS coordinates or Bluetooth Beaconlocations. Such dynamic (spatial) Audio experiences include theorientation of the End User with the dynamic (spatial) Audio experiencesat GPS coordinates or Bluetooth Beacon locations which allows the EndUser to interact with the Audio Augmented Reality experience (i.e., tointeract with inanimate objects).

5.6.2 Control the Flow of the Presented Dynamic Audio Using the AdvancedData Trigger Mobile Tour Delivery System of the Present Invention

As discussed above, the present invention allows a Tour Creator tocreate Audio Augmented Reality experiences anywhere that has GPS signalor Bluetooth Beacons. The resulting experience for the End User is thatthe End User hears audio augmented reality and can interact with it(e.g., an inanimate object) based on their orientation. Thus, thefeature can make inanimate objects feel as if they are “alive”.

5.7 Dig Deeper Data File Delivery Method—Tour Extension “Opt in”

As discussed above, the “Dig Deeper” feature discussed above, and/orother extensions on a tour, allow for an option on tours for the EndUser to break off from the current tour path. These are optionalexcursions and can be chargeable (i.e., the End User can “Opt In” bypaying a fee to access the tour extension/“Dig Deeper” option).

The Dig Deeper Data File Delivery Method allows for a smooth flow ofinformation for the End User to interact with. By way of example but notlimitation, consider the following hypothetical tour: on Stop 2 (i.e., aparticular location/exhibit) of a Tour, the End User is presented with aDig Deeper option to take an optional excursion. If the End User electsto take the Dig Deeper optional excursion, and clicks the button in theapplication on their smartphone indicating the start of the Dig Deepertour extension, the currently-playing audio/data for Stop 2 ends and theaudio associated with the first stop of the Dig Deeper Audio Extensionbegins to play. The End User undertakes the Dig Deeper excursion,playing the audio/data for the optional excursion until the last stop ofthe Dig Deeper tour extension plays.

Once the End User has completed the Dig Deeper excursion and isreturning back to the original tour stop, a new audio/data file plays,in place of the original Stop 2 audio/data file. When the End Userreaches Stop 3 along the tour, the data/audio file triggers with theoriginal Tour continuing. This is an “opt in” option for the End User.It is a choice: the End User can bypass this option if they have nointerest in that particular tour extension. By way of example but notlimitation, consider a situation in which the End User is at the GranaryBurial Ground walking along a Freedom Trail tour in Boston, Mass. TheEnd User encounters a Dig Deeper Tour Extension option that takes themon a 10 minute walk through the Granary Burial Ground. The End User can:choose to go into the Granary Burial Ground and listen to the tourextension by clicking a button on their smartphone/mobile device, whichmay be chargeable (i.e., the End User pays a fee to access the DigDeeper Tour Extension for the Granary Burial Ground). However, inasmuchas this tour extension is optional, the End User could instead choose toskip the tour extension by simply walking along the tour route to thenext stop.

FIG. 21 shows a tour path 165 having locations 1, 2, 3 disposed alongthe tour path, and a Dig Deeper extension 170 having locations i and iidisposed along the Dig Deeper extension. When the End User clicks abutton on their personal electronic device 25 (e.g., a smartphone/mobiledevice), they can “opt in” to start Dig Deeper extension 170.

6. Tour by Numbers Mobile Tour Solution with Sound Innovation and AudioText-to-Audio Translation Innovation for Mobile Tours

6.1 Background—Current State of Indoor Audio Tours (The Prior Art)

Currently, the most common prior art indoor audio tours use handhelddevices that require the user to input a number into the handheld deviceand then the handheld device plays an audio file associated with thatnumber. These handheld devices, while useful, present a large number ofproblems. Further, playing the recordings indoors presents even morechallenges.

Of the indoor audio tour applications that are currently provided, theseapplications access the speaker of the mobile device (e.g.,iPhone/iOS/Android) to play the audio files. When the speaker of themobile device is used to play audio, the audio is very loud and cancause disruptions in many indoor locations. By way of example but notlimitation, imagine 20 people playing audio on the speakers of theircellphones in a museum. Because of this issue, mobile tours oftenrequire headphones to be provided on site, or the mobile tours are notprovided at all.

And, also of note, the “input a number” tours discussed above are notlocation-based—they can be played at any location at any time.

6.1.2 Challenges Faced when Playing Mobile Tour Audio from MobileDevices Indoors

There are multiple issues with the current state of mobile audio tours:By way of example but not limitation, one issue is that the End User hasno control over the volume of the audio tour by the location hosting thetour. That is, current mobile device tours play audio that requires theuser to use the speaker on their mobile device or headphones to listento the tour. This causes a large disruption amongst guests, e.g., wheneveryone in a quiet museum is playing different audio files at differenttimes on their speaker, it creates a loud and unfriendly environment.The visitors could lower their volume, but they have a choice—and theyoften turn the audio up to 100% volume to hear it. This is becausemobile tour applications that play audio do not regulate the volume, sothe user keeps it loud.

6.1.3 Challenge Faced Currently when Offering Audio in Mobile Tours inMultiple Languages

There are multiple issues that arise when offering audio in mobile toursin multiple languages. To offer multiple languages, the location (e.g.,museum) would need to record and upload each translation as a separateaudio language file. As of now, handheld tours and apps have the usersadding individual files to each tour language choice. It istime-consuming to record a separate audio file for each language. It isalso time-consuming to load each language file on each device. Overallit takes a lot of time to add a multi-language tour to handheld devicesor to app tours.

6.1.4 Challenges Associated with Location Awareness

There are also multiple issues with the current state of mobile audiotours and location awareness. Specifically, prior art handheld devicesrunning the mobile tour generally play the audio anywhere (i.e.,regardless of the location of the user). The audio can begin playing atany location, so they are not aware of the location of the handhelddevice within a mobile tour. This means the user could listen to theaudio off-site. Many items on the tour require the user to be at thelocation. If they are not, the experience is not as effective. It alsoallows anyone to listen at any time. Many locations want the user to beon site to listen to mobile tour audio.

6.1.5 Challenges Faced by Handheld Devices

There are multiple issues with the use of handheld devices for mobiletours; some of these issues are discussed in detail below.

6.1.5.1 Management of Devices—Uploading Files/Management

With prior art mobile tour devices, in order to add a new audio tournumber, or create a new location number, the audio needs to bedownloaded to each device. However, it is time-consuming to connect eachdevice to update them individually. Overall, it is not easy, and it istime-consuming, to update handheld devices.

6.1.5.2 Adding New Locations

Similarly, with prior art mobile tour devices, adding a new locationrequires updating an entire tour system. Overall, it is not easy, and itis time-consuming, to add a new location number.

6.1.5.3 Playing Video

In addition to the foregoing, some prior art mobile tour handhelddevices do not have an option for video (i.e., no display/screen), otherhandheld devices need to upload videos individually.

6.1.5.4 Collecting IDs

When utilizing prior art mobile tour handheld devices, ID's or depositsare collected from visitors to use the handheld device. This creates abig cost for human resources. Sometimes visitors do not have anappropriate ID (note: in New York City, they cannot take passports as aform of ID). Without an appropriate ID, visitors are unable to use thehandheld device.

6.1.5.5 Lost/Stolen/Broken Devices

In addition to the foregoing, with prior art mobile handheld tourdevices, many handheld devices are lost, stolen or broken. The lost,stolen or broken handheld devices create a large cost to replace/fix.The lost, stolen or broken handheld devices create fines and costs tovisitors. Since the handheld devices are hardware, they all eventuallybreak.

6.1.5.6 Battery Charging

And, with prior art mobile handheld tour devices, batteries must becharged before handing the handheld devices out to visitors. The needfor maintaining battery life creates complexity when dealing withhundreds or even thousands of devices.

6.1.5.7 Charging for Device

With prior art mobile handheld tour devices, an End User typicallycurrently pays for (or it is free to use) a handheld device. The presentsolution is free for a first-time user with an option to pay tocontinue.

6.2 The Invention: Tour by Numbers Mobile Tour Solution with SoundInnovation and Audio Text-to-Audio Translation Innovation for MobileTours

In general, the present invention comprises the provision and use of anapplication with a multiple tour creation option that is hosted on acentral platform (“WalknTours”) to allow for easy access for users.

More particularly, the present invention comprises a novel method forproviding the audio of a mobile tour to a user using a handheld device.In one form of the invention, audio is provided to the user by accessingthe ear speaker of a cellphone while using location-based awareness of atour site using GPS and/or Bluetooth Beacons. This provides an easy tocreate and manage mobile tour delivery platform. This novel method isapplied to mobile audio tours and a tour creation system to allow foreasy to create, use and manage mobile audio tours.

6.2.1 The Sound Innovation

The sound innovation of the present invention provides multiple ways forthe end user to listen to the mobile application-based audio tour ontheir mobile device using an iOS or Android device. The presentinvention is specifically centered on mobile application-based toursthat play location-based audio (i.e., mobile application-based toursthat provide audio associated with a specific location) and is offeredas a download from the Apple App Store or Google Play. A majorinnovation here is the use of the ear speaker, which is currently onlyused during a phone call, of a cellular phone for the purpose of playingaudio from a mobile tour application.

In one preferred form of the present invention, the ear speaker may beleveraged in order to limit the volume of the sound emitted an EndUser's personal electronic device 25 as an audio file plays on the EndUser's personal electronic device 25. More particularly, mobile phonestypically comprise two speakers: an “ear speaker” that is only used formaking phone calls, and a “loud speaker” that projects the sound of thecall when the speaker button is pressed on the mobile phone, or whenmusic is played on the mobile phone. Currently, all mobile tours andaudio played on mobile phones use the “loud speaker” and only callsaccess the ear speaker.

For the purposes of keeping the volume to a minimum and not disruptingother visitors, the present invention accesses and utilizes the “earspeaker” on mobile devices (iOS/Android). The present invention isintended to be used during mobile audio tours. Prior art mobile audiotours have not utilized the “ear speaker” of a cellphone for use duringan audio tour, or any use outside of taking calls. Thus, the presentinvention significantly improves the indoor usage of a mobile device foran audio tour for mobile device users.

By way of example but not limitation, the following are scenarios inwhich the use of the ear speaker improves the audio mobile tourexperience.

6.2.1.1 Indoors, e.g., Museums

Currently, when in a museum, if a user does not have headphones, thenthey have no choice but to use their loud speaker to listen to aself-guided audio tour. Use of a loud speaker is typically verydisruptive to everyone in the vicinity of the user, particularly in anindoor space such as a museum. If large numbers of persons (e.g., 10people) use their loud speaker to listen to a self-guided audio tour atthe same time, it is difficult to hear the audio, and the ambient noisedetracts from other visitors' experiences. For this reason, museums,libraries and many other indoor locations are not amenable to usingmobile application-based self-guided audio tour solutions.

6.2.1.2 No Headphones

If the user is somewhere (inside or outside) and does not have theirheadphones, it is uncomfortable to use the loud speaker because everyonecan hear what the user is listening to, use of the loud speaker isdisruptive, and in loud environments the user cannot hear the audio fromthe loud speaker.

Also, the user has various choices to listen to audio on the user'smobile device, including but not limited to headphones and/or Bluetoothspeakers or Bluetooth audio-enabled devices.

And the present invention enables use of interactive possibilities (seeabove) vis-à-vis audio delivered to the user.

The novel sound innovation of the present invention (i.e., use of the“ear speaker” rather than the “loud speaker” on a mobile device) may beapplied in combination with the mobile tour by numbers-type system(i.e., a proprietary handset), and with mobile GPS location-based audiotours and Bluetooth Beacon location-based audio tours discussed indetail above. The tour by numbers system is detailed below.

6.3 Location-Based Awareness and Tour by Numbers Mobile Tour DeveloperSystem and Platform

The present invention also comprises the provision and use of an audiotext-to-audio translation feature. The audio text-to-audio translationinnovation for self-guided mobile audio tours offers a Tour Creator aneasy way to develop tours and to quickly add multiple (e.g., virtuallyunlimited) language choices to audio tours. The major innovation herefor mobile audio tours is the ease of use in adding and generatingmultiple languages quickly.

With the present invention, the developer only has to add the dialoguefor the point of interest (tour stop) and that dialogue is generatedinto different language audio files which may be played at the point ofinterest.

To clarify tour stop/point of interest: if the developer creates amobile tour with 5 points of interest, the points of interest would belabeled as 1, 2, 3, 4 and 5. When the user enters point of interest/tourstop 5, the handheld device plays the audio for that point ofinterest/tour stop. If the user chooses Chinese, the audio for point ofinterest/tour stop 5 plays in Chinese. If they choose English, the audiofor point of interest/tour stop 5 plays in English, etc.

The audio text-to-audio translation feature works as follows. The TourCreator adds the Dialogue text of audio/video. The Dialogue text ofaudio/video (which is only in text form) is translated and played forthe user in other languages. The Dialogue text is then pushed to a textAPI and translated to multiple languages (e.g., Spanish, Chinese,French, etc.). The number of languages is limitless, only limited to theAPI. The translation text is pushed to a voice API that converts thetranslation text into speech. The transformed speech (i.e., theconverted translation text) is then used to generate an MP3 file. Theend result is a plurality of possible audio files that can be played bythe End User (i.e., one audio file for each language). The MP3 file isthen associated to the language file in the tour. For example, with theSpanish tour, each location mp3 file is associated with a particularpoint of interest (tour stop) on the mobile tour. The associated MP3file is then played when it is triggered. In the case of tour bynumbers, playing is triggered when the End User enters the locationnumber. For GPS-based tours, playing is triggered when the user'slocation triggers the GPS point. For Bluetooth Beacon-based tours,playing is triggered when the user enters the Bluetooth trigger location(i.e., the area of the Bluetooth Beacon).

The major benefit of the approach of the present invention is that thedeveloper (i.e., the Tour Creator) can create many (e.g., nearlyunlimited) language audio mobile tours with only a single text. The TourCreator does not have to record each language individually and add it asa language option. The Tour Creator simply adds the text, and thesoftware generates many languages automatically, thereby allowing thedeveloper to create multi-language tours in seconds.

The location-based awareness and tour by numbers mobile tour developersystem and platform of the present invention is an easy-to-usemanagement system that allows the developer to quickly create and manage“tour by numbers” tours, as will hereinafter be discussed in furtherdetail.

6.3.1 Step 1—Add Tour Details and Location

The first step according to the present invention is for the TourCreator to enter tour details, and location, into the developer (i.e.,the developer system and platform). This includes a description of thetour, tour information, length of the tour, etc., however, for thepurposes of the mobile tour application, the most important aspect forthe present invention is location. Entering the location into thedeveloper creates an area near a GPS point (i.e., GPS coordinates) ornear a Bluetooth Beacon that sets a distance from that point. The tourcan only begin if the user is in that geographic location.

6.3.2 Step 2—Add Tour by Numbers Points of Interest

The Tour Creator then adds details for each point of interest. Thesedetails include, but are not limited to: Location name, Location numberassociated to the stop, Audio or video for location, Image to bedisplayed and shared, etc. The Tour Creator then adds the text Dialogueof audio/video. (This is the text-to-audio translation innovation formobile tours discussed above). The Dialogue text is then pushed to atext API and translated to multiple languages (e.g., Spanish, Chinese,French, etc.). The translation text is pushed to a voice API thatconverts it into speech. The speech is then generated into an MP3 file.That MP3 file is then associated to the language file in the tour (i.e.,the MP3 file is then associated with a specific point of interest/tourstop location).

FIG. 22 shows an exemplary tour by numbers entry 175 in the mobile tourdeveloper system of the present invention. The Tour Creator fills infield 180 to assign the order number of the location on the tour pathand field 185 to assign the name of the location. The Tour Creator addsthe appropriate dialog to be played by audio at that particular locationin field 190 as plain text (as noted above, the text is converted by anAPI to multiple languages so that an End User may select the desiredlanguage for the tour and hear the location dialogue in that language).The End User can then select a Location image to display to the End Userwhen the End User arrives at the specified location (or previews thetour path) and/or the Tour Creator may add a location audio/video fileto play when the End User arrives at the specified location.

6.3.3 Step 3—Publish

The tour is then published into an app (e.g., “WalknTours”) that is ableto process location-based mobile tours created in our mobile tourdevelopment system as detailed above. This is accomplished by, forexample, generating the tour as the aforementioned tour instruction file30, and then storing tour instruction file 30 in tour database 20 oncentral server 15. The tour instruction file 30 can then be accessed bya proprietary app such as the aforementioned WalknTours App, or the tourinstruction file may be utilized by a third party app in the mannerdiscussed above.

6.3.4 Step 4—Add/Modify

To add or modify a tour number location, or to add a new tour numberlocation, the Tour Creator would simply have to repeat Step 2 (seeabove) and publish the newly-saved tour.

An exemplary interface for End Users to enter location number on amobile device is shown in FIG. 23.

An exemplary audio/image that plays/appears on the mobile device afterentering the location number is shown in FIG. 24.

6.4. The Solution Offered by the Present Invention Solves VariousProblems, Including but Not Limited To:

6.4.1 Uploading Files/Management

The present invention allows a Tour Creator to easily upload mobiletours without having to update each device individually (i.e., becausethe tour instruction file 30 is stored on central server 15). The TourCreator only needs to update the app, which would then be automaticallyupdated on every smartphone. This saves money on human resources.

6.4.2 Adding New Tour Locations

Developers (i.e., Tour Creators) simply add a new tour number locationto an existing tour and that updates the mobile tour in the app (whichis loaded on every smartphone). This saves money on human resources

6.4.3 Additional Benefits

In addition to the foregoing, the present invention also allows the TourCreator to play audio or video, eliminates the need to collect IDs atthe time of the tour (as is necessary when lending out proprietaryhandsets); there is no need to collect IDs when utilizing the presentinvention inasmuch as visitors would use their personal devices with thedownloaded app. This saves money on human resources.

And the present invention also eliminates lost/stolen/broken handsets.There is no need to manage devices inasmuch as the visitors would usetheir personal devices with the downloaded app. This Saves money ondevices.

And the present invention also eliminates the need to charge batteriesof devices lent out to visitors, inasmuch as the visitors can use theirown personal devices with the downloaded app. This saves revenue onhuman resources and electricity. And since the visitor is using theirown personal device, there is no need to charging devices to be lent outto visitors. Hence, the location of the tour itself (e.g., museum) wouldnot need any on-site staff to handle devices lent out to visitors. Thepresent invention provides a solution to accept payment in the appitself. This saves money on human resources

7. “Virtual” Tour

Although the present invention has been described as facilitating aself-guided audio tour wherein the End User walks along the tour path,it should also be appreciated that the present invention facilitates thecreation of “virtual” self-guided audio tours as well.

More particularly, with this form of the invention, the End User is a“virtual” End User and the tour path that is created exists as a“virtual” (i.e., digital) tour path. The digitized visual element of the“virtual” tour may be generated in ways well-known in the art (e.g., inthe manner of a Google “street view” path). With this form of theinvention, the digital “virtual” End User follows the tour path betweenvirtual start and end points, and triggers the playing of audiocorresponding to particular locations along the tour path when thedigital “virtual” End User enters those locations on the digital path.

As with the real-world tour paths discussed above, the Tour Creator hasthe option of creating various interest locations/exhibits/ADTs alongthe virtual tour path that trigger the playing of assigned audio files(e.g., to provide the End User with details about the location).Similarly, the Tour Creator can create “Dig Deeper” optional extensionsto the digital tour path in the same manner as the Tour Creator creates“Dig Deeper” optional extensions to the real-world tour path discussedabove.

Similarly, the novel “dynamic” audio features discussed above withrespect to “real-world” tour paths may also be incorporated into“virtual” (i.e., digital tour paths). Since an IMU is not necessary fora “virtual” tour path because there is no Earth gravity on a digitaltour path to measure, the computer instead merely tracks the orientationof the virtual End User and “dynamic” audio is delivered to the End Useras it would be if the End User were on the real-world tour path.

8. Novel System for Creating and Delivering a Tour to an End User

As noted above, the present invention provides a new and improved wayfor a Tour Creator to design novel audio tours and a new and improvedway to deliver novel audio tours to the personal electronic device(e.g., a smartphone) of a user which avoids the difficulties of theprior art.

One important aspect of the present invention is that it enables a TourCreator to create a mobile tour instruction file 30 that defines theparameters and features of a particular novel audio tour, and which canbe stored on central server 15 (e.g., in tour database 20), such thatany user with a portable electronic device 25 (e.g., a smartphone),equipped with a wireless transceiver 45 for wirelessly receiving and/ortransmitting data from a remote source (e.g., the Internet), locationfinding electronics (e.g., a GPS receiver 50 and/or a Bluetoothtransceiver 55) and acoustic output means 40 (e.g., a speaker,headphones, etc.) can wirelessly connect with central server 15 and runtour instruction file 30 on the End User's own personal electronicdevice 25 so that the End User can engage in the novel audio tour.

To this end, the present invention provide a simple user interface forcreating mobile tour instruction file 30 that is common to every enduser and does not require the end user to install specialized software.

Looking now at FIG. 25, there is shown a web-based interface 195 forgenerating mobile tour instruction file 30. Interface 195 can beaccessed by a user via a common web browser (e.g., via the Internet).Web-based interface 195 allows a Tour Creator to define a new mobiletour and the tour path for the tour, associate images and/or audio withthe new mobile tour (and locations/exhibits on the tour), defineexhibits/locations and their relative position (i.e., vis-à-vis otherexhibits/locations on the tour), set prices for accessing the mobiletour, etc.

In one preferred form the invention, web-based interface 195 allows aTour Creator to create a tour instruction file 30 defined by a mastertour record 200 (which allows the Tour Creator to input detailsconcerning the parameters of the over all tour into tour instructionfile 30), a tour storyboard record 205 (which allows the Tour Creator toplace tour locations on a map as well to lay out the associated tourpath), and a plurality of location records 207A, 207B, etc. whichpermits the Tour Creator to input details concerning the parameters ofindividual locations/exhibits/ADTs along the tour path, as willhereinafter be discussed in further detail.

More particularly, and looking now at FIG. 26, there is shown anexemplary master tour record 200. A tour type field 210 permits the TourCreator to select the type of tour (e.g., GPS tour, Bluetooth Beacontour, tour-by-numbers tour, virtual tour, etc.) by selecting theappropriate radio button. A tour output selector 215 allows the TourCreator to select the desired output operating system for running thetour instruction file 30 (e.g., Android, iOS, both Android and iOS,etc.) by selecting an appropriate radio button. A tour name field 220allows the Tour Creator to input a name for the tour that is beingcreated (e.g., “Weston Historical Tour”). A tour city name field 225allows the Tour Creator to assign a city name to the tour (e.g., via adrop-down menu). A tour category field 230 allows the tour creator toassign the tour to a particular category (e.g., historic, haunted,local, etc.), e.g., via a drop-down menu. A tour duration field 235allows a Tour Creator to assign an estimated time for completing thetour. A “tour preview field” 240 allows a Tour Creator to upload a mediafile (e.g., an appropriate audio file, video file, etc.) that plays as apreview when the End User is reviewing the tour. A “tour in betweenaudio field” 245 allows a Tour Creator to upload a media file (e.g., anappropriate audio file, video file, etc.) that plays during the Tourwhen the End User is between locations set out on the tour path. A tour“paid or free” field 250 allows the Tour Creator to set a price for thetour in a price field 255 that is to be paid by the End User if theywish to undertake the tour, or allows the Tour Creator to make the tour“free”. A tour distance field allows the Tour Creator to set theapproximate distance of the tour (e.g., in miles, kilometers, etc.) sothat the End User can see the approximate distance covered by the tour.A “Dig Deeper enable field” 265 allows the Tour Creator to enable ordisable the optional Dig Deeper extension feature (e.g., via checking abox). If the Dig Deeper extension is enabled, a Dig Deeper “paid orfree” field 270 allows the Tour Creator to set a price for the tour in aprice field 275 that is to be paid by the End User if they wish toundertake the Dig Deeper extension on the tour, or allows the TourCreator to make the Dig Deeper extension “free”.

The type of tour being created by the Tour Creator may be specified inmaster tour record 200 by selecting the appropriate radio button toassign the tour to one selected from the group consisting of a “RunningTour” field 280, a “Reverse Tour” field 285, and a “Loop Tour” field290.

An “Intro Audio” field 295 allows the Tour Creator to either upload anintroductory media file (e.g., an audio file, a video file, etc.) to beplayed when the End User starts the tour or, alternatively, to inputtext into a “Language translation text” field 300 that is then convertedinto audio as discussed above. An “IMU sensor enable” field 305 allowsthe Tour Creator to enable special audio features for the audio that isdelivered to the End User, e.g., such as selecting a radio button toenable the use of headphones that comprise an integrated inertialmeasurement unit (IMU) for determining the orientation of the user,whereby to enable the audio features discussed above. A “walking inwrong direction” field 310 allows the Tour Creator to either permit orprohibit walking the tour path in the opposite direction to thedirection intended by the Tour Creator. A “donation or tip” field 315allows the Tour Creator to specify whether the End User should beprompted to give a donation or a tip if the End User elects to undertakethe tour. A languages field 320 allows the Tour Creator to specify whichlanguages the tour is to be delivered in.

Still looking at FIG. 26, a Start Point field 325 allows the TourCreator to specify the starting point for the tour that is beingcreated. A tour description field 330 allows the Tour Creator to providean overall description of the tour, and a tour info field 335 allows theTour Creator to provide additional information regarding the tour thatis being created. A tour survey field 340 allows the Tour Creator tospecify whether the End User will be prompted to take a surveyduring/after the tour. A tour image field 345 allows the Tour Creator tospecify a particular image to be associated with the a tour that isbeing created, and a tour card image field 350 allows the Tour Creatorto specify a particular image that is associated with the tourinstruction file 30 for the particular tour that is being created andwhich can be easily shared on social media at the completion of the tour(e.g., to help the End User identify a particular tour stored in centraltour database 20).

Looking next at FIG. 27, there is shown an exemplary tour storyboardrecord 205. Tour storyboard record 205 preferably comprises a tour map355 (which may be a map imported from a third party such as Google Maps,etc.). Tour map 355 is preferably an interactive map that allows theTour Creator to place location points 360 (which correspond tolocations/exhibits/ADTs that are to be visited along the tour path),e.g., by clicking on the map to place the location point. A plurality ofcontrol buttons 365 are provided to allow the Tour Creator to place thetour path and/or to place the path for Dig Deeper extensions (ifenabled). It should be appreciated that the particular control buttons365 that appear on tour storyboard record 205 depend upon the particularfeatures that the Tour Creator selects to enable in master tour record200 (e.g., if the Dig Deeper extension is not enabled, buttons to placethe Dig Deeper extension tour path may be hidden and/or disabled). Afterthe Tour Creator has specified the tour path and assigned the tourlocation points 360 for the locations/exhibits/ADTs on the tour path,tour storyboard record 205 automatically generates a tour overview 370that shows the distances between the specified tour points 360, andwhich also allows the Tour Creator to quickly and easily uploadassociated media files for each tour point 360 (e.g., by clicking theassociated “Upload audio” button 375 associated with each tour point360).

Double-clicking on any particular tour point 360 on tour map 355 allowsthe Tour Creator to access the particular location record 207A, 207B,etc. associated with that particular tour point. More particularly, andlooking now at FIG. 28, there is shown an exemplary location record 207Aassociated with a particular tour point 360. A location type field 380allows the Tour Creator to specify the type of audio to be associatedwith that particular tour point 360 (e.g., path audio or Dig Deeperaudio). A Bluetooth Beacon audio field 385 allows the Tour Creator tospecify whether the audio for that particular tour point 360 isassociated with a Bluetooth Beacon. An audio style choice field 390allows the Tour Creator to specify what type of audio is to be playedfor the End User for that particular tour point 360 (e.g., play untilend, play until next trigger, navigation audio, spatial audio until end,spatial audio until next trigger, etc.). A position field 395 allows theTour Creator to assign an order number for a particular location on thetour path (e.g., 1, 2, 3, 4, etc.). A location name field 400 allows theTour Creator to specify a name for the particular tour point 360associated with that particular location record 207A. A locationdialogue field 405 allows the Tour Creator to specify dialogue to bedisplayed to the End User when the End User is at that particular tourlocation point 360. A location image field 410 allows the Tour Creatorto upload an image that will be associated with the particular tourlocation point 360 associated with that particular location record 207A(e.g., to display to the End User during the tour). A location audiotext field 415 allows the Tour Creator to input text to be convertedinto an audio file for delivery to the End User when the End User is atthe particular tour location point 360 associated with that particularlocation record 207A (i.e., the text can be converted to audio in themanner discussed above, and/or converted into other languages asdiscussed above). The Tour Creator may select whether the text added tolocation audio text field 415 is to be converted to audio or whether theTour Creator instead will upload an audio file, by selecting theappropriate radio button 420.

Still looking at FIG. 28, if the Dig Deeper extension option has beenenabled, and if the tour location point 360 associated with thatparticular location record 207A is the beginning of a Dig Deeperextension path, the Tour Creator may specify the name of the Dig Deeperextension path by filling in the Dig Deeper information name field 425.A Dig Deeper return audio text field 430 allows the Tour Creator toinput text to be converted into an audio file for delivery to the EndUser when the End User returns to the particular tour location point 360associated with that particular location record 207A (i.e., the text canbe converted to audio in the manner discussed above, and/or convertedinto other languages as discussed above) after engaging in a Dig Deeperextension (i.e., so that the End User does not have to again listen tothe originally-played audio file associated with that particular tourlocation point 360 after completing the Dig Deeper extension). The TourCreator may select whether the text added to Dig Deeper return audiotext field 430 is to be converted to audio or whether the Tour Creatorinstead will upload an audio file, by selecting the appropriate radiobutton 435.

Thus it will be appreciated that web-based interface 195 allows a TourCreator to create a tour comprising any of the various featuresdiscussed above (e.g., a standard tour path, a loop tour path, a reversetour path, a Dig Deeper extension option, Bluetooth Beacon triggers,etc.), and to set the parameters of the tour (e.g., how large thelocation trigger is around a particular GPS coordinate, etc.), as wellas to provide the appropriate media (e.g., audio files, text, etc.) tobe played/displayed to the user during the tour. Web-based interface 195also allows the Tour Creator to customize various aspects of the tour,e.g., by defining the “dynamic” acoustic effects discussed above andproviding appropriate audio files to play, specifying the order numberof locations/exhibits, etc.

An important feature of web-based interface 195 is that the tourinstruction file 30 that is created may be downloaded and used byvarious applications, and is not limited to proprietary software/apps.As a result, tour instruction file 30 may be used by third-party apps(e.g., hotel apps, museum apps, sports apps, etc.) to provide tours,without requiring the end user to download or install proprietarysoftware. This allows developers to utilize tour instruction file 30 torun tours through existing third-party apps.

Modifications of the Preferred Embodiments

It should be understood that many additional changes in the details,materials, steps and arrangements of parts, which have been hereindescribed and illustrated in order to explain the nature of the presentinvention, may be made by those skilled in the art while still remainingwithin the principles and scope of the invention.

What is claimed is:
 1. A system for delivering a self-guided audio tourto an end user, said system comprising: a central server comprising: adatabase; a tour instruction file stored in said database, said tourinstruction file comprising: a tour path comprising a plurality of tourpoints; location information identifying the real-world position of eachof said tour points on said tour path; and data to be delivered to theend user for each of said tour points on said tour path; and a personalelectronic device comprising: a central processing unit; a wirelesstransceiver in communication with said central processing unit forwirelessly communicating with said central server; a positiondetermination unit in communication with said central processing unitfor identifying the real-world position of said personal electronicdevice; a display in communication with said central processing unit; atleast one acoustic output unit in communication with said centralprocessing unit; and a software app running on said central processingunit for: using said position determination unit to identify thereal-world position of said personal electronic device; comparing saidreal-world position of said personal electronic device with said tourpath to determine if said personal electronic device is located at oneof said plurality of tour points; if the end user is at one of saidplurality of tour points, delivering the data from said tour instructionfile for that tour point; wherein the data delivered to the end usercomprises audio data in the form of an audio recording played on said atleast one acoustic output unit; and wherein said audio recording for agiven tour point is played on said at least one acoustic output unituntil the end of the audio recording for that tour point, even if theend user has moved to a different tour point on said tour path.
 2. Asystem according to claim 1 wherein said plurality of tour points aredefined by one selected from the group consisting of global positioningsystem (GPS) coordinates and a Bluetooth beacon.
 3. A system accordingto claim 1 wherein at least one of said plurality of tour points on saidtour path comprises an optional extension point; wherein said optionalextension point designates the start of an optional tour path extension;and wherein, when the end user arrives at said optional extension point,the end user is given the option of including said optional tour pathextension into said tour path.
 4. A system according to claim 1 whereinthe data delivered to the end user further comprises at least oneselected from the group consisting of presentation parameters for anaudio file, a video file, presentation parameters for a video file, atext file, a machine-translation of a text file, an image file andpresentation parameters for an image file.
 5. A system according toclaim 1 wherein, when the end user is moving from any one tour point onsaid tour path to any other tour point on said tour path, a navigationalaudio recording is delivered to the end user by said acoustic outputunit so as to provide the end user with at least one of (i) directionsfor moving from the current tour point on said tour path to the nexttour point on said tour path, (ii) story information pertaining to thenext tour point, (iii) story information pertaining to another tourpoint, and (iv) other information which may be of interest to the enduser either during or after participating in the self-guided audio tour.6. A system according to claim 1 wherein, when the end user is movingfrom any one tour point on said tour path to any other tour point onsaid tour path, an in-between audio recording is delivered to the enduser by said acoustic output unit so as to provide the end user withaudio when the end user is between tour points.
 7. A system according toclaim 1 wherein said personal electronic device comprises a smartphone,and further wherein said at least one acoustic output unit comprises theear speaker of said smartphone so that said audio recording is played tothe end user through the ear speaker of said smartphone.
 8. A systemaccording to claim 1 wherein said personal electronic device furthercomprises an inertial measurement unit (IMU) for determining thereal-world orientation of the end user, and wherein the data to bedelivered to the end user at a given tour point varies according to thereal-world orientation of the end user at that given tour point.
 9. Asystem for delivering a self-guided audio tour to an end user, saidsystem comprising: a central server comprising: a database; a tourinstruction file stored in said database, said tour instruction filecomprising: a tour path comprising a plurality of tour points; locationinformation identifying the real-world position of each of said tourpoints on said tour path; and data to be delivered to the end user foreach of said tour points on said tour path; and a personal electronicdevice comprising: a central processing unit; a wireless transceiver incommunication with said central processing unit for wirelesslycommunicating with said central server; a position determination unit incommunication with said central processing unit for identifying thereal-world position of said personal electronic device; a display incommunication with said central processing unit; at least one acousticoutput unit in communication with said central processing unit; and asoftware app running on said central processing unit for: using saidposition determination unit to identify the real-world position of saidpersonal electronic device; comparing said real-world position of saidpersonal electronic device with said tour path to determine if saidpersonal electronic device is located at one of said plurality of tourpoints; if the end user is at one of said plurality of tour points,delivering the data from said tour instruction file for that tour point;wherein at least one of said plurality of tour points on said tour pathcomprises an optional extension point; wherein said optional extensionpoint designates the start of an optional tour path extension; andwherein, when the end user arrives at said optional extension point, theend user is given the option of including said optional tour pathextension into said tour path.
 10. A system according to claim 9 whereinsaid tour path comprises at least one selected from the group consistingof: (i) each of said plurality of tour points being assigned a number;(ii) each of said plurality of tour points being assigned a sequentialorder number; and (iii) each of said plurality of tour points beingassigned to deliver all data associated with a tour point to the enduser, even if the end user has moved to a different tour point on saidtour path.
 11. A system according to claim 9 wherein said plurality oftour points are defined by one selected from the group consisting ofglobal positioning system (GPS) coordinates and a Bluetooth beacon. 12.A system according to claim 9 wherein said software app is configured tointerpret taps, swipes, motion or touch by the end user on said personalelectronic device as an input selection by the end user without the enduser having to unlock said personal electronic device.
 13. A systemaccording to claim 9 wherein the data delivered to the end usercomprises at least one selected from the group consisting of an audiofile, presentation parameters for an audio file, a video file,presentation parameters for a video file, a text file, amachine-translation of a text file, an image file and presentationparameters for an image file.
 14. A system according to claim 9 whereinsaid personal electronic device comprises a smartphone, and furtherwherein said at least one acoustic output unit comprises the ear speakerof said smartphone so that audio data is played to the end user throughthe ear speaker of said smartphone.
 15. A system according to claim 9wherein, when the end user is moving from any one tour point on saidtour path to any other tour point on said tour path, an in-between audiorecording is delivered to the end user by said acoustic output unit soas to provide the end user with audio when the end user is between tourpoints.
 16. A system according to claim 9 wherein said personalelectronic device further comprises an inertial measurement unit (IMU)for determining the real-world orientation of the end user, and whereinthe data to be delivered to the end user at a given tour point variesaccording to the real-world orientation of the end user at that giventour point.
 17. A system for delivering a self-guided audio tour to anend user, said system comprising: a central server comprising: adatabase; a tour instruction file stored in said database, said tourinstruction file comprising: a tour path comprising a plurality of tourpoints, wherein at least one of said plurality of tour points is definedby a Bluetooth beacon; location information identifying the real-worldposition of each of said tour points on said tour path; and data to bedelivered to the end user for each of said tour points on said tourpath; and a personal electronic device comprising: a central processingunit; a wireless transceiver in communication with said centralprocessing unit for wirelessly communicating with said central server; aposition determination unit in communication with said centralprocessing unit for identifying the real-world position of said personalelectronic device; a display in communication with said centralprocessing unit; at least one acoustic output unit in communication withsaid central processing unit; and a software app running on said centralprocessing unit for: using said position determination unit to identifythe real-world position of said personal electronic device; comparingsaid real-world position of said personal electronic device with saidtour path to determine if said personal electronic device is located atone of said plurality of tour points; if the end user is at one of saidplurality of tour points, delivering the data from said tour instructionfile for that tour point.
 18. A system according to claim 17 whereinsaid tour path comprises at least one selected from the group consistingof: (i) each of said plurality of tour points being assigned a number;(ii) each of said plurality of tour points being assigned a sequentialorder number; and (iii) each of said plurality of tour points onlydeliver data to the end user after a previous data file has finishedbeing delivered to the end user, even if the end user has moved to thenext tour point on said tour path.
 19. A system according to claim 17wherein at least one of said plurality of tour points is defined byglobal positioning system (GPS) coordinates.
 20. A system according toclaim 17 wherein at least one of said plurality of tour points on saidtour path comprises an optional extension point; wherein said optionalextension point designates the start of an optional tour path extension;and wherein, when the end user arrives at said optional extension point,the end user is given the option of including said optional tour pathextension into said tour path.
 21. A system according to claim 17wherein the data delivered to the end user comprises at least oneselected from the group consisting of an audio file, presentationparameters for an audio file, a video file, presentation parameters fora video file, a text file, a machine-translation of a text file, animage file and presentation parameters for an image file.
 22. A systemaccording to claim 17 wherein said personal electronic device comprisesa smartphone, and further wherein said at least one acoustic output unitcomprises the ear speaker of said smartphone so that audio data isplayed to the end user through the ear speaker of said smartphone.
 23. Asystem according to claim 17 wherein, when the end user is moving fromany one tour point on said tour path to any other tour point on saidtour path, an in-between audio recording is delivered to the end user bysaid acoustic output unit so as to provide the end user with audio whenthe end user is between tour points.
 24. A system according to claim 17wherein said personal electronic device further comprises an inertialmeasurement unit (IMU) for determining the real-world orientation of theend user, and wherein the data to be delivered to the end user at agiven tour point varies according to the real-world orientation of theend user at that given tour point.